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Preface 



In this course of lectures I have discussed the elementary parts of Stochas- 
tic Processes from the view point of Markov Processes. I owe much to 
Professor H.P McKean's lecture at Kyoto University (1957-58) in the 
preparation of these lectures. 

I would like to express my hearty thanks to Professor K. Chan- 
drasekharan, Dr.K. Balagangadharan, Dr.J.R. Choksi and Mr.K.M. Rao 
for their friendly aid in preparing the manuscript. 

K. Ito 
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Section 

Preliminaries 



1 Measurable space 

1 

Let O be a set and let S (O) denote the set of all subsets of Q.. A c S (Q.) 
is called an algebra if it is closed under finite unions and complemen- 
tations; an algebra B closed under countable unions is called a Borel 
algebra. For C c S(Q) we denote by A(C) and B(C), the algebra and 
Borel algebra, respectively, generated by C. M c S (Q.) is called a mono- 
tone class if A n € M, n = 1,2,..., and {A„} monotone implies that 
limA„ e M. We have the following lemma. 

n 

Monotone Lemma. If M is a monotone class containing an algebra A 
then M D B(A). 

The proof of this lemma can be found in P. Halmos: Measure the- 
ory. 

For any given set Q we denote by B(Q) a Borel algebra of subsets 

of a 

Definition (). A pair (Q,, B(Q)) is called a measurable space. A c D.is 
called measurable if A e B(fl). 

Let (Qi, Bi(Qi)) and (Q2, 82(^2) be measurable spaces. A function 
/: Oi — > Q.2 is called measurable with respect to Bi(Qi) if for every 
A e B 2 (0 2 ), f-\A) e Bi(Qi). 

Now suppose that Qi is a set, (Q2, 8(^2)) a measurable space and 
/ a function on Qi into ^2- Let B(/) be the class of all sets of the form 2 
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f~ l (A) for A e B(Q 2 ). Then B(/) is a Borel algebra, and is the least 
Borel algebra with respect to which / is measurable. 

Let (Q ; -, B,-(fl,-)> i e /, be measurable spaces. Let Q. = 0/ Q denote 
the Cartesian product of and let n, ■ : Q — be defined by 7r,-(w) = w,-. 
Let B(Q) be the least Borel algebra with respect to which all the 7r,-'s are 
measurable. The pair (Q., B(fl)) is called the product measurable space. 
B(fl) is the least Borel algebra containing the class of all sets of the form 

{/ : f(i) e Ei\, 

where £; e B,(Q,). A function F into Q is measurable if and only if tt,F 
is measurable for every i e /. 

2 Probability space 

Let Q be a set, Ac S (Q) an algebra. A function P on A such p(£l) - 1 , 
< p(E) < 1 for E e A, and such that p(EUF) = p(E)+p(F) whenever 
E, F e A and E n F = 0, is called an elementary probability measure on 
A. Let (Q, B(Q)) be a measurable space and an elementary probability 
measure on B. If A n e B, A n disjoint, imply p(\J A n ) - ^ p(A n ) we say 

n 

that ^ is a probability measure on B(Q). The proof of the following 
important theorem can be found in P. Halmos: Measure theory. 

3 Theorem ((Kolmogoroff)). If p is an elementary probability measure 
on A then p can be extended to a probability measure P on B(A) if and 
only if the following continuity condition is satisfied: 

A n e A, A n D A n+ u Pi A n - <p imply hmp(A n ) = 0. 

n 

Further under the above condition the extension is unique. 

Definition (). A triple (Q., B, P), where P is a probability measure on B, 
is called a probability space. 

A real-valued measurable function on a probability space is called 
a random variable. If a vandom variable x is integrable we denote the 
integral by E(x) and call it the expectation of X. 
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Let (Q2, B2) be a measurable space, (Qi, Bi, P i)a probability space 
and / : £l\ — > Q2 a measurable function. Define Pi(E) - Plif (E)) 
for every £" € 82- Then (Q.2, B2, P2) is a probability space and for every 
integrable function g on Q, 2 , E(gOf) = j gOfdPi = j gdP 2 = E(g). We 
say that / induces a measure on B2. In case x is a random variable, the 
measure induced on the line is called the probability distribution of x. 

We shall prove the following formulae which we use later Inclusion- 
exclusion formula. Let (Q, B, P) be a probability space and A, € B, 
i - 1, 2, . . . ,n. Then 

p I U At I = Z p(Ad - Z p(Ai n a j } + Z P(A; n a j n A * } - • • • 

i< j<k 



v/=l 



KJ 



To prove this, let xb denote the characteristic function of B. Then 
P(UA,-) - £(Y UA! ) - £(1 -*nA,c) - 1 - £([1^) 
= 1 - £((1 - ATAxXl -AfA 2 ) ... (1 -ATA,)) 



= 1 



E\ 1 - Yu XA ' + Yu Xa ' Xa i ~ Z * A ^ A J*A* + 



K/<* 



= Z " Z £( * A * nA P + Z ^A^-nA*) - 



= JV(A ( )- 2>(A,nA;) + ... 

i i<j 

The following <i«a/ inclusion-exclusion formula is due to Hunt. We 
have 

P(nAd = 1 - P(UA^) - l - { Z p ( A * > - Z P{A i n A P + • • • } 

i i<j 

= 1 " { Z (1 - p(Ai)) - Z (1 - P{At u A ^ )} + ■ ■ ■ } 

(' i<j 
= l_{ n _2p (A .)_Q + ^p (A . A . ) + ...j 



1 -(i) + (2)---l + Z^-Z /, ^ UA ^ + - 
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= J]p(A i )-J]p(A i UAj) + ... 

i i<j 

5 A collection (xt, t e T) of random variables x t , T being some index- 
ing set, is called a stochastic or random process. We generally assume 
that the indexing set T is an interval of real numbers. 

Let {x t , t e T} be a stochastic process. For a fixed a)x t (a>) is a 
function on T, called a sample function of the process. 

Lastly, an n-dimensional random variable is a measurable func- 
tion into R n \ an n-dimensional random process is a collection of n- 
dimensional random variables. 

3 Independence 

Let (Q, B, P) be a probability space and B,-, i - 1, 2, n Borel 
subalgebras of B. They are said to be independent if for any £",- € B,-, i < 
i < n, P(E { n, . . . n E n ) = P(Ei) . . . P(E n ). A collection (B a ) a€l of Borel 
subalgebras of B is said to be independent if every finite subcollection 
is independent. 

Let X\, . . . , x n be n random variables on (Q., B, P) and B(jc,-)> 1 < i < 
n, the least Borel subalgebra of B with respect to which x,- is measurable. 
x\ , . . . x n are said to be independent if B i , . . . , B„ are independent. 

Finally, suppose that [x a (t, w)} a€ ] is a system of random processes 
on Q and B a the least Borel subalgebra of B with respect to which x a (t, 
w) is measurable for all t. The processes are said to be stochastically 
independent if the M a are independent. 

We give some important facts about independence. If x and y are 
random variables on Q the following statements are equivalent: 

6 (1) E{e iax ^y) = E{e iax )E{e^y\ a, and fi real; 

(2) The measure induced by z(w) = (x(w), y(w))on the plane is the 
product of the measures induced by x and y on the line; 

(3) x and y are independent. 
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4 Conditional expectation 

Let (Q, B, P) be a probability space and C a Borel subalgebra of B. 
Let x(w) be a real-valued integrable function. We follow Doob in the 
definition of the conditional expectation of x. 

Consider the set function p on C defined by //(C) = E(x : C). Then 
p(C) is a bounded signed measure and p(C) = if P(C) - 0. Therefore 
by the Radon-nikodym theorem there exists a unique (upto P-measure 
0) function <p(w) measurable with respect to C such that 



Definition (). tp(w) is called the conditional expectation of x with re- 
spect to C and is denoted by E(x/C). 

The conditional expectation is not a random variable but a set of 
random variables which are equal to each other except for a set of P- 
measure zero. Each of these random variables is called a version of 



The following conclusions (which are valid with probability 1) re- 
sult from the definition. 



MC) = E{tp : C). 



E(x/C). 



1. £(1/C) - 1. 
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2. E(x/C) > if x > 0. 



3. E(ax + y6y/C) = aE(x/C) + fiE(y/C). 



4. |£(jc/C)| < E(\x\/C). 



5. If*, 



n 



x, \x n \ < S with E(S) < oo, then 



UmE{x n /C) - E(x/C). 



n 



6. If Z n E(\x n \) < oo, then E(£ x„/C) - Z E(x n /C). 



n n 



7. 



If x is C-measurable, then E(xy/C) = xE(y/C). 

In particular, if x is C-measurable, then E(x/C) - x. 
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8. If x and C are independent, then E(x/C) - E(x). 

9. If C = {A : P(A) = or 1}, then E(x/C) = E(x). 

10. If Ci D C 2 , then E(x/C 2 ) = E(E(x/£ 1 )/£ 2 ) and, in particular, 
E(E(x/C))) - £(x). 

5 Wiener and Poisson processes 

The following processes are very important and we shall encounter 
many examples of these. 

We shall define a Wiener process and establish its existence. 

Let jx ; (w),0 < t < ooj be a stochastic process such that 

(1) for almost all w the sample function x t (w) is a continuous function 
on [0, oo] and vanishes at t - 0; 

(2) P(w : x h (w) € E u ...,x tn (w) - x tn _ { (w) e E n ) = P(w : x h {w) e 
Ei) . ..P(w : x tn (w) - x^iw) € E n , where t\ < t 2 < . . . < t„. 

8 This means that x h , x t2 - x h , . . . , x tn - x tn _ l are independent if 

h< ...<t n ; 

(3) P(w : x t (w) - x s (w) e E) = [2n(t - j)]2 / e'^ l2{t ~ s) dx. 

E 

Then the process is called a Wiener process. This process is ex- 
tremely important and we shall now construct a Wiener process which 
we shall use later. This incidentally will establish the existence of Wie- 
ner process. 

Let O = C[0, oo) be the space of all real continuous functions on [0, 
oo). We introduce an elementary probability measure on Q as follows. 
For any integer n, < t\ < t 2 . . . < t n < oo and a Borel set B" in R", 

let 

E = |w : w € Q and (w(h), w(t n )) e fi" j, 

and 
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Ph...t n (E) = J ■■■ J N(ti,0,xi)N(t2-h,xi,x 2 ) ...N(t n -t n -i,x n -ux n ) 

B" 

dx\ . . . dx n 

where N(t, x, y) = — = e -0-*) 2 /2f 

V2/r7 

If < «i < . . . < u m < oo is a set of points containing t\ , . . . , t n and 
t r - Ui r , r - 1, 2, . . . , n, then E can also be written as 



E 

and then 



= jw : w e Q and . . . , w(w m )) € B m |, 



Pui...uJE) - J - J N(ui,0,xi)...N(u m - u m -ux m -i,x m )dx\ . ..dx m , 

where B m is the inverse image of B m under the mapping (jci, . . . , x m ) — > 
(xij, . . . , x !n of /? m into R n . Using the formula 



N(t, x,y)N(s,y, z)dz = N(t + s, x, z), 



we can show that p Ul .. Mm (E) = p h , „, n (E). 

Now suppose that E has two representations 

E = {w : (w(h), w{t n )) e B n , B n c /?"} 
= {w : . . . , w(s m )) e B m , B m c /? m }, 

and < u\ < . . . < u r is the union of the sets {t\, . . . , t n ) and {s\, . . . , s m ). 
Then from the above, p tl ... t „(E) = p Ul ... Ur (E) = p Sl ,„ Sm (E). Hence 
Ph...t n (E) does not depend on the choice of the representation for E. We 
denote this by p(E). 

The class A of all such sets E, for all n, for all such «-tuples 
t n ) and all Borel sets of R n , is easily shown to be an algebra. 
It is not difficult to show that p is an elementary probability measure on 
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A. This elementary probability measure is called the elementary Wiener 
measure. 

We shall presently prove that p satisfies the continuity condition of 10 
Kolmogoroff 's theorem. Hence p can be extended to a probability mea- 
sure P on B(A), which we call the Wiener measure on (Q., B(A)). It will 
then follow that P(w : w(0) = 0) = 1. 

Now let x t (w) - w(t). Then evidently [x t , <t< oo} is a stochastic 
process with almost all sample functions continuous and vanishing at 
t = 0. We show that {x t , <t< oo} is a Wiener process. 

The function / : (x\,X2) — X2 — x\ of R 2 — > R l is continuous and 
hence for any Borel set E c R l , the set B = f~ l {E) - {(x\,X2) : X2~x\ e 
E} is a Borel set in R 2 . Therefore 

p{w : x, - x s eE} = P{w : (w(s), w(t)) e B = f~\E)} 

N(s,o,x\)N(t - s, x\, X2)dx\ dx2- 

The transformation (jci , JC2) — * (x,y) with x - x\,y - X2 - x\ gives 

P(w : x t - x s e E) = N(s, 0, x)N(t - s,x,y + x)dxdy 

{(x,y):yeE} 

= J N(t - s,0,y)dy. 

E 

Again 

P{w:x h eE u ..., x tn - x, n _, e E n ) = P{w: (w(h), w(t n ) e B"), 

where B n = {(xi, . . . ,x n ) : x\ e E\,X2 - x\ e E 2 , . . . ,x n - n n -\ e E n ). 
11 Therefore 

P{w : x h e Ei x, n - x, n _, e E n \ 

= J "J N (h ,o,x\)... N(t„ - t n -\, x n -\, x n )dx\ ...dx n 

B" 

J N(ti , 0, x\) . . . N(t n -t„-i, 0, x' n )dx\ ...dx' n 
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= P{w : x h e E\ }P{w : x t2 - x h e E 2 } . . . P{w : x tn - x tn _ x € £„}, 

where x\ - x\, x' 2 - x, - i = 2, . . . , n. We have proved that (x t ) is a 
Wiener process. 

It remains to prove that p satisfies the continuity condition. We shall 
prove the following more general theorem. 

Theorem (). (Prohorov, 'Convergence of stochastic processes and limit 
theorems in Probability Theory ', Teoria veroyatnesteii e eyo primenania 
Vol. I Part 2, 1956). 

Let p be an elementary probability measure on A which is a prob- 
ability measure when restricted to sets of srf dependent on a fixed set 
t\,...,t n . Let E denote expectations with respect to p. If there exist 
a > 0, b > 1 and c > such that E(\x t - x s \") < C\ t _ s \b then p can be 
extended to a probability measure on B(A). 

Proof. Let A n D A n+ \,n - 1,2, . . . ,A n e A be such that p(A n ) >e> 0, 
for all n. We prove that f] A n + (p. 

n 

Let A n = {w : (w(tf), . . . , w(r<J)) e B n ], where B n e B(R r ») 
(the set of Borel subsets of R r "). For each n there exists a q n such 12 
that (a) each t. < q n , (b) at most one t. is contained in any closed 
interval [(k - 1)2"«", k2~ q -] for k = 1,2,. . .,q n 2 q ». By adding super- 
fluous suffixes if necessary, one can assume that each point k2~ q " , k - 
0, 1, . . . , q n 2 q ", is in {n , . . . }, and moreover (by adding, say, the mid- 
point if necessary) that in each open interval ((k - \)2~ q " ,k2~ qn ) there is 
exactly one point of (t ( "\ Thus r n = q n 2 q " +1 and t ( £ = k2~ q ". 

Finally, by adding superfluous sets when necessary one may assume that 
q n = n i.e., that 

A n = \ W :( W {t^),..., W ^ n+l ))eB n ), 

where % = k2~" and (tf, ^„ +1 ) c (t^K • • • , • 

Since p is a probability measure when restricted to sets dependent 
on a fixed set si, . . . , Sk, we can further assume that each B n is a closed 
bounded subset R" 2 " +1 . Now, since E(\x(s) - x(t)\ a ) < C\s - t\ h , 

p(w : \w(tf) - w{tf\)\ > \tf - = p( w : |w(^) - w(^)r > 
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> \tf - t^\\ aS ) < C\t) n > - 
Choose 8 > such that A = b - aS - \ >0. Then 
p(w : \w{tf ] ) - w{tf\)\ > \tf ] - < C\t\ n) - tf\\ l+A < C2 
Hence 



An) An) ib-a6 



■n(\+X) 



(n2" 



U(^:K^Vw(S)|>|^-ei 5 ) 



i=2 



Cn" +l 

< — t— = 2.C.n.2- An . 

2«(i+) 



Since £ «2 M is convergent, there exists m a such that 2C 2 

n=mo 



n - "- 1 < - 
2 < 2' 



Then for I > tuq, 

l n n+1 

U n(^:K^)-w(S)|>|f -fil 5 ) 



«=m i=2 
( I «" 2 +1 



e 



and so 



n=m a (=2 

It follows that 
P 



2 



Ai n p p (w : |wOf ) - wOf )| < |*f> - t^f) 

n=mo i=2 



e 



and so this set is non-empty. Call this set B' v Then Z?^ D B' l+l and 

CO 

A; D B' v We prove that f| B\ + <p. 

mo 

From each choose a function w; linear in each interval [tf^^jf]- 
Such a function exists since for each w e B\ there corresponds such a 
function determined completely by . . . We can as- 

sume that w(tf) = 0, since zero never occurs in the points which define 
sets of A. Now if / > m 



wi(tf) - w,(Ci)l < \t?' - W * 2 ~"°> m o <n<\,\<i< n2 n+ \ 



An)- 



An) An) ,6 



n6 



■>«+! 
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so that \wi{k2' n ) - wi{{k - l)2"' l )| < 2.2-™ 1 < k < n2 n ,m < n < I. 
Given k2~ l , k'2~ l , k' < k, kT l < 2" m °, there exists q < I such that 2~ q < 
kT l - k'2~ ] < 2~ q+l . In the interval [k'2~',k2~ 1 ] there exist at most 
two points of the form j2~ q , (j + 1)2-4. Then since w/ e B' q , \wi(j2~ q ) - 
w/(0'+ 1)2 _? )| < 2.2~ qS . Repeating similar arguments we can prove that 

|w/(Jfc2 -/ ) - wi(k'2~ l )\ < 4(1 - 2- 6 y l 2- q6 < A\k2~ l - k'2~ l f, 

A being a constant. Now we can easily see that 

- m(tf )l < H\tf - tff if |f - tf\ < 2~ m « say. 

From this easily follows, using linearity of wi in each interval 
[tf, fjJJ, that if tf <t<s< tf, then 

|w/(f) - < 4/x|f - f®|«. 

Now since e A; for every p > 0, (w 1+p (tf), . . . ,wi +p (tf l+1 )) e 
Bi. Since B; is compact, this sequence has a limit point in B/. Since 
the same is true for every /, we can by the diagonal method, extract a 
subsequence {w n \, say, such that w n (/P) converges for all i and for all I. 

Now let to and n > be given. For large no suppose that ^" o) < to < 
t (*o) f | f («o) _ f (no) < 2 -«o < Then if I and m are large and tf a) < tf < 

to < t% < < <t < C < we have 

\wi(t ) - w m (t )\ < - wt(tf)\ + \ Wl (tf) - Wl (tf Q) )\ + |w^ ( " o) ) 

-w m (tf Q) )\ + \w m {tf 0) ) - w m {t^)\ + |w m (4 m) ) - w m (t )\ 

< \t - tff + tAtf - t^f + 772 + - tPf M + \t™ - tof < A m , 

A being some constant. This is true for any t € [fr° ,tr°f]. This 
shows that the limit exists at every point of R'. Also using |w/(0 - 
wi(s)\ < 4/j.\t ( : l) - tff, we easily see that the limit function say w, is 

1 J 

continuous. Also since (w(tf, . . . , w(tf l+1 )) e Bi for all /, f| B' { + (p. 

l>mQ 

We have proved the theorem. 
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In our case we have 

i r 

p(x t - x s e E) - [2n(t - s)] * e 2 «~^dx 

E 

□ 

16 Poisson processes. Let (x t , < t < oo) be a stochastic process such that 

1. for almost all w the sample function x t (w) is a step function in- 
creasing with jump 1 and vanishes at t - 0; 

(t - s) k A k 

2. P(x t -x s =k) = e~ A( '- s) - -r — with A > 0; 

k 

3. P(x h e E u x t2 - x h e E 2 , . . . , x tn e E„) = P(x h e E\) . . . P(x tn - 
x tn _ x € E„); i.e., x H , . . . , x, n - are independent if t\ < t 2 . . . < 
t n \ then the process is called a Poisson process. 



Section 1 

Markov Processes 



1 Introduction 

17 

In the following lectures we shall be mainly concerned with Markov 
processes, and in particular with diffusion processes. 

We shall first give an intuitive explanation and then a mathematical 
definition. The intuitive model of a Markov process is a phenomenon 
changing with time according to a certain stochastic rule and admitting 
the possibility of a complete stop. The space of the Markov process 
has the set of possible states of the phenomenon as its counter-part in 
the intuitive model. Specifically, consider a moving particle. Its pos- 
sible positions are points of a space S and its motion is governed by a 
stochastic rule. The particle may possibly disappear at some time; we 
then say it has gone to its death point. A possible motion is a mapping 
of [0, oo) into the space of positions. Such a function is a sample path. 
The set of all sample paths is the sample space of the process, denoted 
by W. A probability law P a governing the path of the particle starting at 
a point a e S is a probability distribution on a Borel algebra of subset 
of W. The stochastic rule consists of a system of probability laws gov- 
erning the path. Finally, the condition on the system, that "if the particle 
arrives at a position 'a' at time t f it starts afresh according to the prob- 
ability law P a ingonoring its past history" will correspond intuitively to 
the basic Markov property. 

Definitions (). We turn now to the mathematical definitions. We first 18 
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explain the notation and terminology which we shall use. 

Let 5 denote a locally compact Hausdorff space satisfying the sec- 
ond axiom of countability. Let B(5) denote the set of all Borel sub- 
sets of 5, 3$(S) the set of all B(5)-measurable bounded functions on 5. 
Since 5 satisfies the second axiom of countability, this class coincides 
with the class of all bounded Baire functions on 5 . We shall add to 5 a 
point oo to get a space 5 U {oo}. 5 U {00} has the topology which makes 
5 an open sub-space and 00 and isolated point. Then if B(5 U {00}), and 
38(S U {00}) are defined in the same way, B(5) c 1(5 U {00}), and for 
any / e @{S) if we put /(oo) - 0, then / e 3§(S U {00}). A function 
w : [0, 00] - 5 Voo is called a sample path if 

(1) w(oo) - 00; 

(2) there exists a number a" 0o (w) e [0, 00] such that w(t) - 00 for 
t > o-coiw) and w(t) e 5 for t < CToo(w); 

(3) w(t) is right continuous for t < cr^w). 

For any sample path w, o" 00 (w) is called the killing time of the path. 
For any path w we denote by x t {w) the value of w at t i.e., x t (w) - w(t). 
Then we can regard x as a function of the pair (t, w). Given a sample 
path w the paths w~ and defined for any s by 

x t (w~) = x tAs (w) ift < 00, 

19 and 

Xoo(w~) - OO, 

where 

t A s = min(?, s); 
x t (w + s ) = x t+s (w), 

are called the stopped path and the shifted path at time s, respectively. 
A system W of sample paths is called a sample space if w e W implies 
Wj e W,wJ e ff for each s. For a sample space W the Borel algebra 
generated by sets of the form (w : w € W,x t (w) € E), t € [0, 00), 
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E e B(5) is denoted by B or B(W), and ^ or @(W) denotes the set of 
all bounded B-measurable functions on W. The class of all sets of the 
form (w : w~ e B)B e B, is called the stopped Borel algebra at s, and 
is denoted by B. v or B S (W). S3 will denote the system of all bounded 
B v -measurable functions. Note that B s increases with s and B^ = B. 
Consider the function x(t, w) on R x W into S U {oo}. Let 



Then x n (t, w) is measurable with respect to R(R) x B(W) and x n (t, w) 
— > x(?, w) pointwise. x ? (w) is therefore a measurable function of the pair 20 



(1) S is a locally compact Hausdorff space with the second axiom of 
countability; 

(2) W is a sample space; 

(3) P a (B) are probability laws for a e 5 U [oo}, 8eB, i.e., 

(a) P a (B) is a probability measure in Bfor every a e S U {oo}, 

(b) P a (B), for fixed B, is B(S )-measurable in a, 

(c) P a (x = a) = \, 

(d) P a has the Markov property i.e., 



fixed t, B2, p x ,(w)(B2) is a bounded measurable function on W.] 




(t,w) 



Definition (). A Markov process is a triple 



M - {S, W,P a ,a e 5 U {00}) 



where 
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Remark 1. (d) is equivalent to the following: 

fem,ge® imply J f{w)g{w+)dP a = E a [f(w)E Xt(w) (g(w'))] 

More generally (d) is equivalent to 

(d') fe&,,ge&,Bie B t , B 2 eB imply 

E a [f(w)g(wt):weB u wt eB 2 ] 

= E a [we Bi;f(w)E Xt ( w )(w' e B 2 : g(w'))]. 

S , W, P a are called the state space, sample space and probability 
law of the process respectively. 

We give below three important examples of the sample space in a 
Markov process. 

(a) W - W rc = the set of all sample paths. These processes are called 
right continuous Markov processes. 

(b) W = Wd { - the set of sample paths whose only discontinuities 
before the killing time are of the kind, i.e., w(t - 0), w (t + 0) 
exist and w(t - 0) ^ w(t + 0) = w(t), t < CFoo{w). These are called 
Markov processes of type d\ . 

(c) W = W c = the set of all sample paths which are continuous before 
the killing time. These are continuous Markov processes. 

Remark 2. A Markove process is called conservative if P a ((Too = °°) = 
1 for all a. 

3 Transition Probability 

The function P(t,a,E) - P a {x, € E) on B(S),a e S and < t < oo 
being fixed, is a measure on B(5) called the transition probability of P a 
at time t. The transition probability has the following properties: 

(T.l) P(t, a, E) is a sub - stochastic measure in E, i.e., it is a measure in 
E with total measure < 1 . 

For P(t, a, S) - P a (x t e S) = 1 - P a (X t = oo) < 1. 
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(T.2) Pit, a, E) € &(S) for fixed t and E. 

For P(t, a, E) = P a (B) where B = {x, e E] and P a (B) is by defini- 
tion B(5')-measurable in a for fixed B. 

(T.3) P(t, a, E) is measurable in the pair (f , a) for fixed E. For / € 3S(S ) 
let 

H t (f(a)) = j P(t,a,db)f(b)= J f(w(t))dP a . 



-f 



W-{x,-oo} 

f(w(t))dP a , since /(oo) = 0. 



If / is a bounded continuous function and S n I 

lim H t+6n f(a) = lim I f(w(t + 6 n ))dp a . 
w 

.)w(t + 5 n ))dP a 

w 

f(w(t))dp tl . 

w 

since w(?) is right continuous. 

H t f(a) is thus right continuous in if / is bounded and contin- 
uous. It is not difficult to show (by considering simple functions 
and then generalizing) that H t f(a) is measurable in a if / is mea- 23 
surable. Therefore H,f(a) is measurable in the pair (t, a) if / is 
continuous and bounded. Further, if {/„} is a sequence of measur- 
able functions with \f n \ < r\ and f„ — > /, then H t f n — > H t f. The 
class of those measurable functions / for which H t f(a) is measur- 
able in the pair (t, a) thus contains bounded continuous functions 
and is closed for limits. Therefore H t f(a) is measurable in the 
pair a) for / € &(s). If / - X e, HJ(a) - P(t, a, E). 



(T.4) lim P(t, a, U a ) = 1, where U a is an open set containing a. 

t o 
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Let t n i 0, and B n - {w : w(t n ) e U a }. Since w(t) is right continu- 

oo oo 

ous, {w : w(0) e U a c U 4 

n=l m=n 

Therefore 



liminfPfe,a, C/ a ) > P a 
t„lo 



un 



n=l m=n 

> P a {w : w(0) e U a \ > P a {w : w(0) - a} - 1. 



(T.5) Chapman-Kolmogoroff equation : 

P(t + s,a,E) = J P(t,a,db)P(s,b,E). 



P(t + s,a,E) = P a {x, +S eE} = P a {x t e S,x t+S e E\ 
= P a {x t eS.x s (wt)eE} 
= E a [x t e S : P x ,{x s (w) e E}] 
= E a [x t eS :P(s,x t ,E)] 

= J P(t,a,ab)P(s,b,E) 



(T.6) 



P a (x tl eEi,...,x tn eE n )= J I P{t u a,dai) 

P(t 2 - ti,a\,da 2 )-- • P(t n - t n -i,a n -\,da n ) 

We shall prove this for n - 2. 

P a (x t] e E u x t2 e E 2 ) 

- P a (x t i e Ei,X(t 2 - tl ) +tl =ee E 2 ) 
= P a (x tl € E u x t2 - tl w+ e E 2 ) 

= P a (w e B u w+ e fi 2 ),#i = [x h € E x ] and fi 2 = [x t2 - h e E 2 ) 
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= J P(ti,a,dai)P(t 2 -h,auE 2 ) 

= JJ^ P(t\,a,da\)P(t 2 — t\,a\,da 2 ). 

(T.7) Suppose that M l = (S u W u P' a ,a e Si U {oo}) and M 2 - (S 2 , W 2 , 

P 2 ,, a e S 2 U {oo}) are two Markov processes with S i - S 2 , Wi - 25 
W 2 and P'(t,a,E) = P 2 (t,a,E): then Mi = M 2 , i.e. P\ = P\. 

Proof. Any sub-set of W of the form 

{(x tl ,...,x t JeE 1 x---xE n },E i eB(S), 

is in B(W). Since B(W) is a Borel algebra, any set of the form 

{(x h ,...,x tn )eE n eB(S n )} 

is in B(W). The class of all sets of the form 

{(x tl ,...,x tn )€E n ,E n €B(S n )} 

for all n, for all n-tuples < t\ , . . . , t n < oo and all Borel sets E n of S n , 
is an algebra A(W) c B(W). Further A(W) generates B(W). □ 

For fixed < t\, ...,t n < oo, let 

^(E") = /* {(x tl ,...,* t „)e £"},i = 1,2. 

Then P' a is a measure on the Borel sets of S n . From (T.6) it follows 
that P\{E n ) - Pq(E"), for all sets E n which are finite disjoint unions of 
sets of the form 

Ei x...xE n ,Ei eB(S). 

Such sets £" form an algebra which generates 1(5"). Using the 26 
uniqueness part of the Kolmogoroff theorem, we get Pl(E n ) - P 2 a {E n ) 
for all E n e B(5"). 

Thus = P„ on A(W). One more application of the uniqueness of 
the extension gives the result. 
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T.8 Suppose that M = (S, W, P a , a e S U {oo}) is a triple with 5 and W 
being as in the definition of a Markov process, and P a , a e S U{oo} 
are probability distributions on B(W) and let 



Suppose further that p(t, a, E) satisfies the properties (T.2), (TA) and 
(T.6). Then the contention is that M is a Markov process with P(t, a, E) 
as the transition probability of P a . 

To prove this we have to verify conditions (b), (c) and (d) on P a . 
The proof of b) is similar to that of (T.6). (T.6) shows that P a (B) is 
measurable in a if B is of the form 



where E" is a finite disjoint union of sets of the form E\ x E2 x • • • x E n , 
Ei e B(5). For fixed t u ...,t„, consider the class X of sets E" e B(S") 
for which 



27 lim E" - E", P a Ux h , . . . , x t J e E"\ is a monotone sequence and 



X is therefore a monotone class and hence X D B(5"). We have thus 
shown that P a (B) is measurable in a for all B e A(W). Similarly we 
show that the class of sets B € B(W) for which P a (B) is measurable in 
a, is a monotone class. 

We now verify (c). Choose t n J, such that 



P(t,a,E) = P a {w:w(t)eE}. 



{(x(h),...,x(t a )) € 



cS") 





Pb{«»} = PbK e C/ a } > 1-e . 



Since w(t) is right continuous 



00 



00 
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Where U a denotes the closure of U a . Therefore 
1 > P a (w : w(0) eU a )>l-e. 
Since e arbitrary, P a (w : w(0) € U a ) - 1. Now we choose adecreas- 

oo 

ing sequence {U l a } of open sets such that U' a D and \J U' a - {a}. 

i i 

We then have 

DO 

P a (x - a) = e C£)) = lim P a (x e ££) = 1. 

To prove (d) we proceed as follows. First remark that if / e 38{S n ) 28 
and F" e B(5") and B = {{X h ,...,x t JeE n then 

J" P(h,a,da a ) ■ ■ ■ P(t a - t n -i,da„)f(a . . . ,a n ) = J f[x h , . . . ,x tn ]dP a . 

E" B 

Let B\ e 38 t be given by B\ = (w : e B') where B' = (x^ e 
E\,...,x t > n e E n ); then fii - (x t . e F,-, 1 < i < n) with t{ - tAt' { , 1 < i < 
n. Let B2 £ B2 be given by 

B 2 = (x Sj e F,-, 1 < j < m). 

We have 

P a (w e € B 2 ) = P a (x„ € Ei,x, +Sj e F 7 ) 

= F(x ?/ € £,-, i,eS, x ;+iV; € Fy) 

= J" P(h,a,da{)- P(t n -t n -i,a n -i,da n )P(t-t n ,a„,dc) 



ajSEj 
ceS 

I 



P(si,c,dbi)...P( 



- J P{t u a,da l )...P{t-t n ,a n ,dc)P c {B 2 ) = J P X ,{B 2 ) 

aj£Ej,c€S B 

by the above remark. We now fix B 2 and prove that the above equation 
holds for all Bi e S$ t [the proof runs along the same lines as the proof 
of b)]. Finally fix B] e SB t and prove the same for all B 2 e B. 
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4 Semi-groups 

29 Let H,f(a) = J P(t, a, db)f(b) = E a {f(x t )\. Then H, is a map of &(S) 
s 

into 38(S) with the following properties: 

(H.l) It is linear on 3§{S) into 38{S). It is continous in the sense that if 
\f n \ < M and /„ -» / then H,f n -» tf f /. 

(H.2) > 0, in the sense that if / > 0, HJ > 0. 

(H.3) It has the semi-group property i.e. H t H s = H t+S . 

H t+S f(a) = E a (f(x t+S )) = jp(t + s, a, db)f(b) 

s 

= J f(b) J P(t,a,dc)P(s,c, 



db) 



= J P(t,a,dc) J f(b)P(s,c,db) 
s is 



= J P(t,a,dc)H t f(c) 

s 

= H t H s f(a) 

(h.4) m < i 

(H.5) H,f(a) is B(7?')-measurable in t. 

(H.6) If / is continuous at a, limH t f(a) - f(a). 

For if U a is an open set containing a 

*,/<„> - r^*iA»-/^*ww 

S U a 



U a S-Ua 



5. Green operator 
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= f(a)P(t, a, u a ) + J P(t, a, db)[f(b) - f(a)] + J P(t, a, db)f(b). 

U a S~U a 

30 

Now use the fact that P(t, a, U a ) — > 1 and / is continuous at a. 



5 Green operator 

We have seen that the operators {H t } form a semi-group. We now in- 
troduce one more operator, the Green operator, as the formal Laplace 
transform of H t , which will lead to the concept of a generator. 

oo 

Consider the operator G K = j e~ xt H t dt, defined for oc> by 



oo 

G a f{a) = J e- xt H t f(a)dt,f e @{S). 



G is called the Green operator on 3§{S). Interchanging the orders of 
integration, we also have 



G a f(a) = E a 



J e- at f(x t (w))dt 
o 



Let Gia,a,E) - J e at Pit,a,E)dt. This measure on 1(5) is called 
o 

Green's measure on E(S). We have 

oo oo 

Gafia) = J e~ at H t f(a)dt = J f(b) J e - at P(t,a,db)dt 

S 

= J Gia,a,db)fib). 

s 

The operator G a has the following properties: 
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(G.l) G a is linear, and continuous in the sense that if \f n \ < 77 and /„ — > 31 
/, then G a f n (a) -> G a f(a). 

(G.2) G a >0,i.e. G ff />0if/>0. 

(G.3) G a satisfies the following equation, called the resolvent equation: 
G a - Gp + {a - p)G a G p = 0. 

We have 

H s G a f(a) = J P(s,a,db)G a f(b) 

s 

CO 

= J P{s,a,db) J e- at H t f(b)dt 

S o 

00 

= J~ e~ at H t+S f(a)dt (interchanging the order of integration) 



CO 

= e as J e~ at H t f(a)dt. 



Therefore 



00 

GpG a f(a) = J e-&H s G a f(a)ds 


CO CO 



s 

t 





Gpfja) - G a f{a) 
a -{3 



6. The Generator 
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Remark. H t H s - H t+S - H s H t and 

Gp — Gcc 
G k Gb — — - GrG k 

oc -fj 

(G.4) G a \ < -, because H t l < 1 
a 

(G.5) The integral defining G a exists for complex numbers whose real 
part > for every / e 38{S). Then G a f(a) is analytic in a for 
every / e 38{S ) and every a e S . 

(G.6) / is continuous at a implies 

aG a f(a) — > f(a) as oc— > oo. 

oo oo 

For aG a f{a) = J ae- at H,f(a)dt = J e 'H t f(a)dt and 
o o — 

oc 

H t f(a) — > f(a) as f — » if / is continuous at a. 

6 The Generator 

Define, for/ € BS(S) 

= sup \f(a)\. 

aeS 

Then |ff ( /(a)| < ||/||. 

33(S) is a Banach space with the norm ||/||, and H t becomes a semi- 
group of continuous linear operators on 38{S). 

Consider the following purely formal calculations. 

<g = hm — — - [—] t =o 
r->0 t dt 



Then 

dHr Hr+x — Ht Hx — I 

— - = lim — = lim — H t = 

dt s^o 6 6 
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Therefore H t - and 



oo oo 



-i 







or 



<9 = a - G , 



a 



The above purely formal calculations have been given precise mean- 
ing, and the steps justified by Hille and Yosida [ ] when H t satisfy certain 
conditions. In our case, however, H t do not in general satisfy these con- 
ditions, and we shall define ^ with the last equation in view. We now 
proceed to the rigorius definition. 

Let Si a - Ga[S$(S)],3l a = G~ l {0} be the image and kernel of G a 
respectively. We show that Si a and 9t a are independent of a and that 
S$ a n 9t tt = {0}. The resolvent equation gives 



Gpf = G a [f + {a-p)Gpf] 
Since f + (a-/3) Gpf e S$(S), it follows that 

GpfeG a [S$(S)] = S? a , 

or that Sip c Si a . Interchanging the roles of a and ft, Sip D Si a or 
34 M a = Sip. We denote G a [&(S)] by Si. Similarly / e % gives Gpf = 
and the resolvent equation then gives G a f = or 'Sip c 9J a . We denote 
G~ l {0} by 31. Let u e St n Then u - G«/ for some / e ^(5), and for 
every /?, = 0. Now 



and so H s u{a) is continuous in s and — > as s — > 0. Also, since 



G a -G fi f + (a-fi)GaQfif = 



i.e. 



CO 




CO 



/ e-P s H s u(a)ds = Gpu(a) = for all j8, tf,u(a) = 0. 



o 
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Letting j^Owe see that u(a) - 0. 
For u e R define 

^ a u = au- G~ a x u. 

^ a u is then determined mod 9J. We now prove that is independent of 
a. If / = ^ a u{ mod 9t) then f - au - G~V ( mod 91) and 

Go,/ - aG a u — u 

GpG a f = aGpG a u - Gpu, 

G a -Gp G a - Gp 

— / = a— u - Gpu, 

p-a ft- a 

G a f - Gpf = aG a u -fiGpu, 

Gpf = G a f - aG a u +/3Gpu 

- -u + [3Gpu 

f=fiu-Gp 1 u (mod 91) = g^u (mod 91) 

We denote & a u by Wu. Then if G a f = u we have 
Sfw = au - f (mod 91). 

Thus w = Ga/ if and only if (a - &)u - f( mod 91). The domain 
S>{^) of is 8% and we have W = a - G~ l . is called the generator of 
the Markov process. 

The following theorem shows that the generator determines the Mar- 
kov process uniquely. 

Theorem ()• Let M { = (S, W,P' a ,ae S V {oo}), i = 1, 2, be two Markov 
processes, and&i,i = 1,2 their generators. Then if&\ = &2, P l a ~ ^a> 
i.e. Mi = M 2 . 

Proof. = G a [8$(S)] = Since <S X = & 2 , Wi) = 

i.e. 8? 1 = 8$ 2 = 8% (say). Since their ranges must also be the same 

SRi = 912 = 9t(say). We have therefore 

(a-& l )G a f = f (mod 91) 
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= / (mod 9t)[(a - <fi0lf{a - Wj] 
= (a-W 2 )G 2 J (mod 51), 
(a - <g)G l J = (a - W)G 2 J (mod 31) since Sfi - Sf 2 

□ 

By definition ar - = a - W\ - G'~ l Therefore 
G?G l a f = G l ; 1 &2f (mod 31) 

G i/ = G lf 

Therefore G l a f = G 2 f. This gives 

oo oo 

J* e- at H}f(a)dt = J e~ at H 2 f(a)dt for every F e <^(S) 



Thus if / is continuous, Hjf(a) = H 2 f(a) 

J P\t,a,db)ffl = J P 2 (t,a,db)f(b) 

for every / € 38{S ) which is continuous. Therefore 
P\t,a,E) = P 2 (t,a,E), 

Hence 

P l - P 2 

1 a 1 a- 



7 Examples 

We first prove a lemma which will have applications later, and then we 
give a few examples of Markov processes. 

Let / be a real -valued function on an open interval (a,b). When / 
is of bounded variation in every compact sub-interval of (a, b) we write 
/ e Z${a, b) and then there exists a unique signed measure df Lebesgue- 
Stieltjes measure) such that df(a,fS\ = f(fi+) - f(a+), (a, ft] c (a,b). 



7. Examples 
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Suppose that /i is any measure on (a, b) which is finite on compact sub- 
sets of (a,b). Suppose further that there exists a function <p on (a, b) 
which is yu-summbale on every compact sub-interval of {a, b) and satis- 
fies 



f(fi+)-f(a+) = J tpffid fi(g). 

a 

Then df - (pdfi and / is absolutely continuous with respect to d/u. 
We now prove that following 

Lemma (). Iff, g e <%W(a, b) then fg e <%W(a, b) and 

d(fg)x = f(x+)dg(x) + g(x-)df(x). 

Proof. We can assume that / and g are non-negative and non-decreasing 
in (a, b). It is enough to prove that if h is continuous in {a, b) and has 
compact support, then, 



f h(x)d(fg)(x) = f h(x)f(x+)dg(x) + f h(x)gix-)df(x). 



For n - 1, 2, ... let {a n ^}, k - 0, ±1, ±2, ... be a sequence of points 
such that 

«<-•••< a n >0 < <■■■-> b, a nJ - ar„ ,_i < - 

Define 

tp n (x) = a nJ 

, , . II 1 < * < 

Then 

CO 

= ^ h(a n j)[f(a ny n+)g(a nyi +)-f(a n j-i+)g(a nyi -i+) 
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= ^ h(a„j)f(a n j+) ■ [g(a, v -i+)] - g{a n j-i+) 

i=—oo 

CO 

+ ^ %»,i-iMvi + )[/Ki-i + )-/( ff »,i-i + )] 

/'=— CO 

- J h[<p n (x)]f[<p n (x)+]dg(x) + J h[t// n (x)]g[i/f n (x)+]df(x) 

Since h has compact support, letting «^oowe get the result. 

Ex.1 Standard Brownian motion 

Let S = R 1 , W = C[0,oo) [we define w(oo) = oo]. Let P be the 
Wiener measure on W and define for a e S , 

P a (B) = P{w: w + a e B\, Be B(W). 

It is not difficult to show that (S, W, P a ) is a Markov process ; that is 
a continuous process and is called the Standard Brownian motion. 
We shall determine the generator of this process. We have 

P(t, a,E) = P(w:w + aeE) = — Lr- f e~ x2/2t dx 

Vint J 

E-a 

- J" N(t,a,c)dc. 

E 

r r e -(b-a) 2 /2t 

H t f(a)= N(t,a,b)f{b)db = f( b )db. 

J J V2/r7 

R' -oo 

lfue^,u = G a f for some / e 3S(R X ) and 

oo oo oo (h _ a) 2 

u{a) = G a f (a) = J e~ at H t f{a)dt = J f(b)db J * dt 

-co 

CO 

= J J—e-^-^mdb 



V2^ 
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a 



J ila J V2a 



Since g -VSa a nd J e^ h f{b)db are both in &W(-oo, oo) we get 

— CO 

from the lemma 



du(a) = -^e-^ a da f -^—e^ h f{b)db+ 

J V2a 



e-^ a e^ a f(a) 

—da 



+ 



^2a y/2a 

^e^ a da f -Le~^ h f(b)db- e -^-^^-da. 
J V2a Y2a 

a 

Therefore u is absolutely continuous and 40 

a oo 

u(a) = -e~^ a J e^ b f(b)db + e^~ aa J e~^ b f(b)db 

-oo a 

almost everywhere. Using the lemma again we see that u' is absolutely 
continuous and we get 

u" - 2au - 2f almost everywhere. 

Let ^ + - {u :e t%(R'), u abs. cont, u' abs. cont, u" € g$(R x )\. We 
have seen above that if u e R, then u e Conversely let u e & + and 

put f - au - -u" . Then / € 3§{R l ) and v - G a f satisfies 

l - v " = av-f 
2 

Therefore w = v - u satisfies 

-w" - aw = 0. 
2 

Hence w = c\e^" a + C2e~^" a . Since w is bounded, c\ - - or 
u = G a f. Thus we have proved that 

f = 23{R X ), u abs.cont, u abs.cont, u" e 3S{R l )\ 
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If / € 91, u - G a f = and since u" - 2au - 2f a.e. we see that 
/ = a.e. Therefore 



hence <S - — — -. 

2 da 1 

Ex.2 Brownian motion with reflecting barrier at t = 0. 

Let (S - (-oo, oo), W, P a ) denote the Standard Brownian motion. 

Let S - [0, oo) and W the set of all continuous functions on [0, oo) 
into 5. If B e B(W) then B e B(W). Define P a (B) = p a [w : \w\ € B] for 
a e s. Then (S,w, P a ) is a continous Markov Process and is called the 
Brownian motion with reflecting barrier at t = 0. 
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Also the formula u' 



.a 



31 = {/:/ = a.e.). 

= 2aM - 2/(a.e.) shows that = —(a.e.) and 



1 d 2 



We have 



P(t, a, E) 



P a {w : HOI € E\ 
P a {w : w(t) eEU (-£)} 




E 



oo 









— CO 



where f(b) = Therefore 



CO 








CO 
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42 From the previous example it follows that u e 3S(S), u is absolutely 

continuous, u' is absolutely continuous and u" e £$(§). Since u(d) = 
u(a) for a > 0, we see that w e 3§{S), u is absolutely continuous for a > 
0, m' is absolutely continuous, u' e &(S). Further since u(a) - u(-a) 

we see that u'(a) - -u'(-a) and hence u'(0) - 0. This gives w + (0) - 0. 

1.1 
The relation -U" - au - f gives -u" - au - f 

5R = {/:/ = 0a.e.} 

^ = {u:ue 38(S), u, u abs.cont, m + (0) = and u" SS(S)} 
Wu = au - f - ^w" (a.e.) 

Ex.3 Poisson process 

Let P) be a probability measure space and [tj(t, oj), < t < oo} a 
Poisson process on Q. 

Let S - {0,1,2, },W - W dl - the set of all sample paths 

whose only discontinuities are of the first kind, and hence they are step 
functions with integral values. For almost all oj, £(t, oj) is a step function 
with jump 1 and vanishes at t = 0; therefore, for almost all oj, g(t, oj) is 
a step function with integral values and hence belongs to W. 

Let rf k \t, oj) - k + g(t, oj) and define 



UEcS, 



P k (B) = P{oj : rf%M e B\,B e B(W). 



P(t, k, E) = P(oj : k + £0, oj) e E) 
= P(oj : £(t, oj) e E - k) 

-AW 



2 ' 

0<neE-k 



e 



k<neE v ' 



H t f(k) = Yf(n + k)e M( — 
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u(k) = G a f(k) = J e~ at £ f(n + k)e- Ati -^ 
o 

= Yf(n + k) r. 

n=0 



Therefore we obtain 



/(*) « 
u(k + 1) - u{k) = — I- —u{k). 

A A 

If u = G a f - 0, from the above we see that / = 0, and 
SR = {/:/ = 0}. 

Let u e ^(5) and put /(A;) = aw(A:) - /1[m(A: + 1) - n(jfc)]. If v(£) = 
G a f(k), v satisfies 

v(* + 1) - v(k)- = -ffi + ^v(fc) 
and hence, subtracting, 

a[v(Jfc) - w(Jfc)] - /l[v(l + 1) - u(k + 1) - v(Jfc) + w(ifc)] - 

and so 

v(k + 1) - u(k + 1) = ^^MA) - "(*)] 
A 

If v(0) * m(0), \v(k) - u(k)\ = (^— )V(0) - w(0)l -» oo which 
is impossible since v - w e £8(S). Therefore v(0) - u(0) and hence 
v(k) - u(k). Thus we have 0t - 38(S). 

Ex. 4 Constant velocity motion 

Let 5 =R\ W = C[0,«x>). Let 



P a {w(0 = a + At, < t < oo} - 1. 
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Then for any B € B if w(t) - a + At e B, P a {B) - 1 and otherwise 
P a (B) = 0. 



P{t,a,E) =5{E,a + At) = 



1 if a + At e E 
if a + At$ E 
H t f(a) = f(a + At) 



CO 

u{a) = G a f(a) = je> J e~^f{t)dt. 



From the lemma and the absolute continuity of u, 

u (a) = —u(a) (a.e.) 

A A 



So if G a f = 0,f = a.e. 

91 = {/:/ = a.e., 
Iclicae 3${R l ), u, abs.cont, u' e m(R 1 )} 
- au - f = Au' 

So that = A^-. 

da 

If m e M, we have u € £%(R l ), u abs.cont. and u' e £%(R l ). Con- 
versely, let u satisfy these conditions and f - Au - u' . Then v = G a f 
satisfies 

ay-Ay = f. 
The general solution therefore is 

y - G a f + Ce>. 

Since y is to be bounded, C = 0. Thus 

^ = [u:ue ^(R l ),u abs.cont, u e m(R 1 )] . 
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Ex.5 Positive velocity motion 
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Let S - (n , r-i) and v(x) > a function continuous on (r\ , r2) such 
that for ri < a < ft < r2 
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/dx C dx 
< +oo and +oo. 
v(x) J v(x) 



Then there exists a solution of — = v(£) with the initial con- 

dition £ (a) (0) = a. 
Let W = W c and 

P a {x,(w)=£ (a) (0,0<f<oo} = l. 

This is similar to Ex.4 and we can proceed on the same lines. 

8 Dual notions 

Let M = (S, W, P a ) be a Markov process and 9J? the set of all bounded 
signed measures on B(5). 9JI is a linear space. For E e B(5) and /i € 2R 
define 

\\fi\\ - total variation of n - sup \jjl{E) - /u(E c )] . 

EeB(S) 

H* t n(E) = J P(t,a,E)n(da) 

s 

CO 

G>(£) = J e- at H* t ii{E)dt. 
o 

Then H*fi and G* /i are in jfi and 

< iNi.ra < — 

a 

Also, for / e &(S), denote by (J,H*n) and (f,G* a /f) the integrals 
J f(a)H*fi(da) and J f(a)G* a [i(da) respectively. We have 

(/,#,V) = J f{a)H* t ^da) = JJ f(a)P(t,b,da)/u(db) 
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= J H t f(b)fi(db) = (fl t f,n) 
Similarly (/,G» = iG a f,p). 



Theorem 1. 

G* a -G* p + {a- f3)G* a G*p = 0. 

Follows easily from (/, G* a p) = (G a f, p) and the resolvent equation 
for G a . 

Theorem 2. &* a = G* a ^# is independent of a. We denote this by 

Follows from Theorem [2 

Theorem 3. IfG* a p = 0,pe 2Ji, then p = 0. 

Proof. Let / e C(5). Then since aG* a p = we have 

- (f,aG* a fi) = (aG a f,/j.) -> if,p) 

as a — > oo. Hence, for every / e C(S),(f,fi) = 0. It follows that 
p = 0. □ 

Theorem 4. Sf^ = a - (G*) _1 w independent of a. We denote this by 
and call it the dual generator ofS. 

Proof is easy 

Theorem 5. Ifu e # - Sf, v € ^* = *) tfien 

(SfB,y)-(«,Sf*v). 

Proo/ Let u - G a f, v = G* a &. Then 

(Sf w, v) = (or v _/, v) = (a H , v) - (/, v) 

- (a u , v) - if, G* a p) = (w, av) - (G a , f,p) 
= (u, a, v) - (u, p) = (u, av — p) = (u, c £*v). 
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This theorem justifies the name dual generator . 

Theorem 6. <S* determines the Matkov process i.e. if Mi - (S \ W, P l a ), 
i - 1,2 are two Markov processes with S 1 = S 2 , W 1 = W 2 and = 
<g 2 *, then P\ = P 2 a . 

Proof. Since <g u = <g 2 *, @{<g u ) = @{<g 2 *). Let n e W and v - G l * a p. 
Since v e 3){<g 2 *), v = G 2 * a m. Now av -^i = ^ u v = £f 2 *v = av-p\. 
Hence fi\ - fi2 i.e. G^*fi - G 2 *p. Now for any / € 38{S), and for any 
fx e 

(G l a f,fi) = (J,G l a *p) = (/,G^u) = {G 2 J,p). 

It follows that G\f = G 2 J, i.e. Hjf(a) = H 2 f{a) for almost all 
t. If / e C(S), H\f(a)i - 1,2 are right continuous in t and are equal 
almost everywhere. They are therefore identical. Now the proof can be 
49 completed easily. □ 

Example. Consider the standard Brownian motion. Then 
= {v : v(db) = db J p(da)G(a, \a - b\)\. 
This means v(E) = J db J /u(da)G{a, \a - b\) where 

E 

CO 

-I 



The formula shows that v has the density 



G(a.\a b\)= j e~ dt N(t,a,b)dt = _J_g-V2^-a|_ 

V2^ 

o 



u(b)= f -^—e-^ b - a ^{da) 
J V2a 



ab C _L e ^ afl(da) + e ^b r _L e -^ a n(da). 
J V2a J ila 



9. A Theorem of Kac 
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Now using the lemma of §0we see that 



O oo 



and hence u is absolutely continuous and 

b 



-oo b 

Using the same lemma again we see that 

oo 

du\b) = -2fi(db) + ^Jladb J e _V5 *- a| (da) 

— OO 

= -2/d{db) + 2av(db). 

Thus we have Sf*v - arv - u- -du l . 

2 

9 A Theorem of Kac 

We prove the following 

Theorem (Kac). Let M = (S, W, P a ) be a Markov process. For k, f, e 
£§(S ) we define 
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v(a) - v(a, a) = E a 



oo 

j e- a, f{x t )e-& k{x * )ds dt 



where a > \\k \\ sup(-k(a)v0), {(avb) = max(a,b)}. Then 

(k + a - Sf)v = /. 
[Ifk > 0,\\k~\\ = 0anda> 0]. 
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Proof. We have 



f oo 

J 



v-u = E a \ J ° - 1]& 

= -E a \ I e" ff 7(x,) I e . k{x s )ds-dt 



Now 



/J 





- f it(*s)de 



OO 

< J 11/11 ||^lk- (a - ||r|l)f ^ 



< oo. 



51 Changing the order of integration 



oo oo 



if C -Jk(x e )d0 

u - -E a I k(x s )ds I e f(x t )e s dt 



oo oo 



= -£« \J k(x s )ds j e-* t+s) f(x t+s )e 



t+s \ 

f k(x e )d6 

dt 



r r -J Ux g+S )d9 

I e as k(x s )ds I e~ at f(x t+s )e » </, 

s 

/ oo oo r 



OO 



o 

CO 





e cfr 
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00 



oo 



e~ as ds E a 







<T as ^ £ a [fc(x>fe)] 



= -G a (*,v)(a)e 



Since 



Further 
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G a l [v - u] = -kv mod (31) and G" 1 = a -<£ 
{a - &)(v -u) = -kv (mod 91) 
(a - Sf)v - (a - S7)n = -Jfcv (mod 31) 

(a - S7)v - / = -ifev (mod 31), (or -<f)u = f (mod 31) 
= (a + ife - Sf)v = /• 

This proves the result. 



□ 



As an application of Kac's theorem consider the standard Brownian 
motion (S,W,P a ). Let 

0(0 = the Lebesgue measure of (s : x s > and < s < t). 
= the time spent in the positive half line up to t. 

Note that 0(0 is continuous in t. 
Then we shall prove that 

P [(p(t) € dr] 1 



dr 



n Vt(? - t) 



so that 



P (w : 0(0 < t) = - are sin 

7T 



^,0<r< 
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We have 6<&{t) = J k(x s )ds where 
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k(d) = B if a > 
= if a < 0. 



Therfore /3<1>(0 = J k[x(s, w)]ds, considered as a function of w is 



measurable in w. Let 



Then 



V(fi,t,a)=E a (e-^). 



<p(B, t, a) = E a 



( ' \ 

- J k(x, )d. 

e 



e^ T P a mt)edT) 

*J — oo 
s*oo 

Jo 

for, if B c (-oo, 0) then P a {w : 0(0 e B) = 0. Also if v(a) = v(J3, a, a) = 

CO 

f e~ at <p(8, t, a)dt we have 


v(a) = E a ^ e- at f(x t )e-& k(x ° )ds dtj where /= 1. 
From Kac's theorem, v is a solution of the differential equation 

72 



i.e., v satisfies 



/ 1 d 2 \ 



1 d 2 \ 



9. A Theorem of Kac 



43 



54 



Id 2 . 

a -2^ y=llfa< ° 



The general solution of this equation is 

y= — tA^^ + A^ 1 , x>0 
a + 6 

= - + B ie ~^ x + B 2 e^ x , x<0. 
a 

Since v is bounded A 2 - B\ - and using the fact v is continuous 
and V is continuous at we have 

v(0) = vOS,a,0)= ' 



^fa^a + B 



Now 



CO t 



f e~ M f 1 -^—e-^ds dt 

J J yln(t - s) yns 
o o 

CO CO 

= (> * f —^e-'dt 
J y/ns J ^n(t - s) 

s 

CO oo 

= [ e -P s — f —e' a ^dt 
J s/ns J yjni 


oo oo 

= C e -(.^ds r _}_ e - atdt 

J sins J ynt 

o o 

1 



yja(a + ft) 



Therefore, 



oo t 



f e- at <p(J3,t,0)dt = v(0)= f e' at f 1 -^—e'^dsdt. 
J J J yrtt - s) yns 

o o 
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55 

t 

Fixing p, since this is true for all a, and (p(J3, t, a) and J , == 

' 

e~$ s ds are continuous in f, we have 



J V^C^ _ s ) v ns 
o 

oo ? 

i.e., f g-^PoWO e £/t) = f <r^ s — 1 rf.v. 

o 

Thus finally 



o o 



Section 2 

Srong Markov Processes 



1 Markov time 

56 

Definition (). Let (S , W, P a ) be a Markov process with W = W rc , Wd { or 
W c . A mapping cr : W — > [0, oo] is called Markov time if 

(w : cr(w) >t)e B f . 

It is easily seen that w — > is a measurable map of W — > W. In 
fact, it is enough to show that 

w w~(0 = x(crA?, W) 

is measurable, and this is immediate since x(s, w), o~(w), t and w are all 
measurable in the pair (s, w). Similarly, w — > is measurable. 

The system of all subsets of W of the form (w : e B), B e B, 

is denoted by Bo-. Bo- is a Borel algebra contained in B. We shall give 
examples to show that cr is not always Bo- -measurable. However, if cr < 
oo,Xo- = w(cr(w)) is Bo--measurable, for x a - lim w~(t) and Xo-(w t -) is 

t— >oo 

Bo- -measurable for every 

If cr is a Markov time, then cr+ e is also a Markov time for every 
e> 0. It is not difficult to see that Bo-+e increases with €. Let 

Bo-+ - |^| Bo- +e = |^| Bo-+ i/„. 

e>0 n 
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Then 1^+ d and Bo- + c Bo- +e for every e> 0. The class of all 
bounded IV -measurable functions is denoted by B a and the class of all 
bounded Bo- + -measurable f unci tons by £§„■+. 

Theorem (). <x(w) is ~B>cr+ -measurable. 

Proof. We shall prove that for every e> 0, cr{w) = cr(w~ +g ), from this 
the theorem follows. Let wo e W. If cr(wo) = °° the equality is trivial. 
Let t = cr(wo) < oo. Now 



(w : cr(w) >()eB,cB, 



for any e> 0. Also 



(w : cr(w) > = I I w : <x(w) 



> r + 




It follows that 



(w 



cr(vv) = € B, 



Hence 



(w : tr(vv) = t) - (w : w ?+e e B) 



for some B € B. Since cr(wo) = ? we see that {wo) t+e e B. 
Hence 



So 



cr[(w ) t+E ] 



i.e., 



[(woV (vvo)+e ] ^ o-(wo), 



completing the proof. 



□ 



2 Examples of Markov time 



2. Examples of Markov time 
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2. cr - cr G = inf . {t : x t (w) e G) 

- first passage time for the open set G c S . 

We have 

{w : cr G < t] = {w : 3s < t and x s e G} 

= {w : 3r < t, x r e G and r rational } 

= \J {w : x r {w~) € G) . 

r 

r rational, r<t 

Thus ctq is a Markov time. 

Remark, cr - ctg is not always Bo-measurable. If cr is a Markov time 
which is Bo-measurable, then 

{w : cr{{w) < c} = {w : w a e B, B e B} , 

and since (w~)~ = w~, we should have cr(w a ) < c. In particular, if cr 
is Bo-measurable and cr(w) < oo, then cr(w~) < oo. Now consider a 
Markov process with 5 - (-oo, oo), W - W c and let cr = cr G where 
G = (0,oo). Let w(0 = -1 + t. Then cr(w) = 1. Also w"(0 = -1 + ? if 
t < 1 and w~(?) = if t > 1. Therefore cr(w~) = oo. Hence cr cannot be 
Bo-measurable. 

3. If G - {oo}, ctq = (Too - killing time. 

4. Let W = W c and 

cr - cr F = inf .{t : x t e F} . 

where F is closed in 5 . Let G m D G m+ i be a sequence of open sets 

such that P| G m = F, and let cr = lim cr Gm . Then <r is measurable 

m m 
[actually it is a Markov time]. We easily verify that 

I cr if cr < (To,, 
<TF = 1 f ~ 

OO II O" — (Too. 
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2. Srong Markov Processes 



It follows that o~f is measurable. Now it is easily verified that 

[w : cr F (w) < i] - [w : cr F (wJ) < t] ; 

in fact the closedness of F is not necessary to prove this. Since w — > w~ t 
is Bf -measurable, it follows that o> is a Markov time. 

3 Definition of strong Markov process 

Let M be a Markov process. M is said to have the strong Markov prop- 
erty with respect to the Markov time o~ if 

P a (w : w e B u w+ e B 2 ) = E a (w e B 1 : P X<T (B 2 )), 

where B x e 8^+ and B 2 e B. 

Remark. The above condition is equivalent to 

Ea(f(w)g(w + a )) - E a (f(w)E Xa (g(w'))), 

or, more generally, to 

E a (w eB u w + a eB 2 : f(w)g(w + a )) = 

= E a (w € B 1 : f(w)E Xa (W e B 2 : g{w'))), 

60 where 

/ e ^ (T+ ,g e SB, Bi e B (T+ and B 2 e B. 

Definition (). M is called a strong Markov process if it has the strong 
markov property with respect to all Markov times. A strong Markov 
process is called a diffusion process if W - W C (S). 

4 A condition for a Markov process to be a storng 
Markov process 

We shall later give examples to show that not all Markov processes are 
strong Markov processes. The following theorem gives a sufficient con- 
dition for a Markov process to be a strong Markov process. 



4. A condition for a Markov process.. 
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Theorem (). Let M = (S,W, P a ) be Markov process and C{S) the set of 
all real continuous bounded functions on S. IfH t maps C(S) into C(S), 
then M is a strong Markov process. 

Proof. Let cr be a Markov time. We have to show that 
E a {f{w)g{wD) = E a (f(w)E Xir (g(w'))). 

□ 

Let 8 > and / e 38 a +. Then, since / e 38 for every €> 0, 

(w : t - 6 < f(w) <t) = (w: w~ +e e B), B e B. 
Also (w~ +€ )~ +e = w~ +€ . Therefore 

i - 8 < f(w~ +€ ) < t. 



Putting t - f(w) + 6 and letting 6 — > we get /(w) = /(w^+g). 



for/e^+andgi, g 2 e ^(5), 

£ a (/(w)gl(*fi+o-)g2(*fe+o-)) = £ fl (o~ < 00 : /(w)gl(*f 1+0 -)g2(*fe+o-)) 

and 
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[mo~] + 1 



, then <x m > cr and cr m — > cr as m — > oo. We have 



/( w cr m ) ^ /("W m -<r) - f(w). 

If gi, g2 e C(5), g;U fi+0 - m ) -> giCfy+o-), i = 1,2, as m -» oo. 
We have therefore 



£ a (/(w)gi(x ?1+cr )g2(xr 2+0 -)) = 

- lim £ a (cr < oo : f(w~ m )gi(x tl+0 - m )g 2 (x t2+0 - m )) 



oo 
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= lim^ £a[* : f{w k/m )g l {x, l+k / m )g 2 {x t2+k / m ), 

m^oo ^ 

k-\ k 

since cr m - k/m if < cr < — . From the definition of Markov time, 

m m 

[cr > - — - ) e Bh cBi, (o- > k/m) e B k/m , 

\ m J n m 

62 so that * e Bt/ m . Therefore form the Markov property we have the last 
expression equal to 

oo 
k=l 

CO 

yt=l 

= lim £ a [cr < oo : f(w~ )F(x„- m j\ , 

m—*oo L m J 

where F(xa- m ) = E Xcrm {gi(x tl )g 2 (x t2 )}. Also, 
= £ , fofei(x fl )g 2 (x f2 )) 

= ^i. \g\(x tz (w~J)g2(x t2 - h {w^))\ , if ? 2 > *1, 

= E b [gi(x t2 (w~))E Xn (g2(x t2 - h (w')))] 
= E b [g l (x tl )H t2 ^ l g 2 (x tl )] 
= H h [ gl H t2 . h g 2 ] (b). 

Thus F(b) is continuous in b since H t : C(5) — > C(S). 
Therefore 



£a[/(w)gitei+o-)g2fe 2+0 -)] = 

= E a [cr < oo : /(w)£^(gi(* fl )g 2 (>? 2 ))] 
= £o[/(w)^(glUfi)g2(^ 2 ))]- 
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Generalizing this to n > 2, we have, if e C(S), 

E a [f(w)gl(x tl+(r ) . . . g n (x tn +a)] = E a [f(w)E Xir (gi(x tl ) . . .g„(x tn ))]. 

The same equation holds if g t e &(S). If B e B and B = (w : 
w(ti) eE u ..., w(t n ) € E n ), then 

X B (w) = X El (x h ). . . X En (x t J, 

and therefore, 

E a f(w)X B (wt) = E a [f(w)E Xcr (X El (x h ) . ..X En (x tn ) 
- E a [f(w)E Xir (X B (w'))]. 

The equation 

E a (f(w)g(wt)) = E a [f(w)E Xtr (g(w'))] 
follows easily now for g e SS. 

5 Example of a Markov process which is not a 
strong Markov process 

The above theorem shows the all the preceding examples of Markov 
processes are strong Markov processes. The natural question is whether 
there exist Markov processes which are not strong Markov processes. 
The following example answers this question in the affirmative. 

Suppose that Q(P) is a probability space and t(w), w € O, a random 
variable on £l(P) such that 



P{w : t(w) e E) = I Ae~ M dt, A > 



Such a random variable is often called exponetial holding time. 
Let S = [0, oo) and W - W c . Define 



£ a \t,w) = a + t, a >0; 
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r\t.w) = 0, if t < t(w), 
t - t, if t > t(w). 



^ a \t, w) are random variables on D.(p) and for fixed w are in W c . For 
B e B(W) and < a < oo, define 

P a (B) = P[w: £ (a \.,w) € B]. 

For a > 0, then, P a (B) = 1 if € B and = otherwise. 

To show that M = (S, W,P a ) is a Markov process, we have only to 
verify the Markov property. To do this, we show that if f\,f 2 € 3S{S), 
then 

E a (fi(x tl )f 2 (x t2 )) = H h {f\H t2 - tl f 2 ){a). 
Denoting by E the expectiation on Q., we have 

H t f(a) = f(a + f),a> 0; 
H t f(0) = E (f(x t )) = E(t < t;f(t - r)) + E(t < r; /(0)). 

So if a > 0, 

E a (fi(x tl )f 2 (x tl )) =fi(a + h)f 2 (a + t 2 ). 

= fi(a + h)H t2 - h f(a + h) 
- H h {fiH t2 - h f 2 )(a) 



If a = 0, we have 

£o(/i(* fl )/ 2 (* t2 )) - £(r < h;Mh - r)f 2 (t 2 - t)) 

+ £(fi < r < ? 2 ;/i(0)/ 2 fe - r)) + £fe < r : /l(0)/ 2 (0)) 

- J flit i - s)f 2 (t 2 - s)Ae- As ds + M0) 



tl 

J fiih - s)Xe~ As ds + /i(0)/ 2 (0)<T^ 



5. Example of a Markov process.. 
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= J Mh - s)f 2 {h - s)Ae~ As ds + fi(0)e~ Atl 
o 

t 2 -h 

J fliti -h- s)Ae~ As ds + /i(0)/ 2 (0)<T^ 
o 

= J Mh - s) [H t2 - h f 2 (h - s)] Ae~ As ds + MO)e~ Atl 
o 

- t 2 -h 

J flit! -h- s)Ae~ As ds + / 2 (0)e- ite - fl) 

- o 

= J Mh - s)H t2 _ h f 2 (h - s)Ae' As +M0)e- At, H t2 ^f 2 (0) 
o 

= fffc- fl /2](0). 

66 

The following facts are easily verified: 

3l = {f:f = 0a.e., /(0) = 0} ; 

2% - [u : u abs.cont. in (0, oo), u,u' £ (0, oo)J ; 

&u(a) = w'(a) for a > and Sfw(0) - [w(0+) - u(0)]A. 

We now show that M is not strong Marko process. Let cr = ctq, 
where G - (0, oo). We shall show that M does not have the strong 
Markov property with respect to the Markov time cr. We have, 

A = P Q (cr > 0, cr{Wt) > 0) - 0, 

since <x(wj) - 0. Also 

{w : r(w) > 0) c {w : cr(^ (0) (., w)) > 0), 

and hence 

P (w : cr(w) > 0) = : cr(£ (0) (., w)) > > Pfw : r(w) > 0} - 1. 
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Note that w(cr(w)) = 0. If M has the strong Markov property with 
respect to cr, we should have 



= A = P Q (o- > 0, cr«) > 0) = £ (cr > 0; P^(cr > 0)) 

= £ (cr > 0; P (cr > 0)) - 1 • P (cr > 0) - 1, 

67 but this is absurd. 

6 Dynkin's formula and generalized first passage 
time relation 

We now prove some theorems on Markov processes which have the 
strong Markov property with respect to the Markov time cr. 

Theorem 1 (Dynkin). If u(d) = G a f(a), then 



M(a)= J B fl y e~ at f{x t )dt 



+ E a (e- a(r u( XlT )). 



Proof. We have 



u(a) - E a 



f 



e~ at f(x t )dt 



= E a ^J e- at f(x t )dt 



+ E n 



; 



e- at f(x t )dt 



and 



IOO \ / OO 

J e- at f{x t )dt \ = E a \ e~ acr J e- at f(x t (wt))dt 

CO 

= J e~ at E a (e~ aiT f(x t (wt)))dt 



6. Dynkin 's formula and generalized . 
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e- m E a (e- acT E XiT (f(x t ))dt, 



o 



because M has the strong Markov property with respect to cr. (Note that 68 
if if is a Borel function on the real line, then <p((r) € 38). 

Therefore 



E a 



J e~ at f(x t )dt 
vo 



■\ ( oo 

= E a 



J e- a<T E XiT (e- at f(x t ))dt 



vo 

= E a (e- a<T u( X(T )). 



Before proving Theorem EJ we prove the following 
Lemma (). Let 

Haidt db) — PaVcr € dt, x a £ db] 

be the meausre induced on the Borel sets of R' X S by the mapping 
w — > (o-,Xcr)ofWintoR'xS. Letip(t,b) be a bounded Borel measurable 
function on R' X S. Then 



J e- at p a (dtdb) J e~ as ip(s,b)ds 

[o,oo)xS ' V=0 



= J e at dt J (p(t - s, b)p a (ds db) 
[o.t]xJ 



Proof. We have 



f e- a, n a {dtdb) J e~ as ip{s,b)db 

[0,oo)x5 
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69 where 



oo 

= J n a {dt db) J e~ as ip(s - t, b)ds 
[0,oo)x5 t 

oo 

= J /u a {dt db) j > F(t,s,b)ds 



[0,oo)x5 



Fit, s,b)-e as ip(s - t, b), if s > t; 
0, if s < t. 



Changing the order of integration we get the last expression equal to 



oo oo 



J ds J F(t, s, b)n a {dt db) = J e as ds J <p(s - t, b)/i a {dt db) 

[0,oo)x5 [0,oo)x5 

This proves the lemma. □ 
Theorem 2. (Generalized first passage time relation). Put 
Q(t, a, E) - P a (x t € E and cr > t). 

Then 

P(t, a, E) = Q(t, a,E)+ J P(t - s, b, E)p a (ds db) 
[0,t]xS 

Remark. When cr is the first passage time, this is usually known as the 
'first passage time relation' . 



Proof. We have 



Ea [I e ~ a ' f(Xt)dt 



I do 

4f 



E a \ \ e~ at f(x t ) X (t)dt 

[0,o-] 



6. Dynkin's formula and generalized ... 57 

CO 



Further 

Eaie-^uiXo-)) = J e- at u(b)n a (dt db), 

[0,oo)xS 

and since u(b) = J e~ as H s f(b)ds, we have from the Lemma, 

o 

CO 

Eaie-^uter)) = J e- at dt J H t _ s f{b)Ha{ds db). 
t=0 [0,t]xS 
From Theorem therefore 

DO tX> 

J e~ at H,f(a)dt = u(a) = J e~ at E a {cr > t : f(x t )dt 
o o 

CO 

+ J e~ at dt J H t - S f (b)fi a (ds db). 
t=0 [0,t]xS 

Since the last equation is true for all a > 0, we have for almost all t, 

H t f(a) = E a (o~ > t; /(*,)) + J H t ^f{b)^ a {dsdb). 

\0,t]xS 

Now suppose that / is bounded and continuous. Then 

H t f{a) - E a (a > t : /(*,)) = E a (cr < t;f(x t )) = E a (f(x t ) X Ww))) 

[0,f] 

is right continuous in t since f(x t ) and x ^re right continuous in 

[0,fl 

Further 

J H t - S f(b)n a (dsdb) = J X m] {s)H t - s f{b)na(ds db) 
[0,f]xs [0,ooM 
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and so is also right continuous in t. Therefore the above equation holds 71 
for all t if / is continuous and bounded. It follows easily that for any 
/ e S${s) the equation is true identically in t. Putting / = Xe we get 
Theorem 

The following rough proof should give us an intuitive explanation 
of Theorem |2 

P(t, a, E) - Q(t, a, E) = P a {x t € E, t > cr) 

t t 



-ff 

s=0 S 
t t 

-II 

s=0 s 
t t 

-II 

s=0 S 
t t 

-II 



P a (cr € ds,Xa- € db, x t € E) 



P a (o- € ds,X s € db, x t -s(Wt) e E 



P a (o- e ds, X s e db)P h (x t ^ s e E) 



Pit - s, b, E)fi(ds db). 

4=0 S 

We give below two examples to illustrate the use of Theorem|2 □ 

Example 1. Let M be the standard Brownian motion, E e B(0, oo) and 
a > 0. Then we shall prove that 

P a (x t eE, t< ctq) = J [N(t, a, b) - N(t, a, -b)]db 

E 

72 where o~o(w) = inf(f : w(t) = 0), 

Since w(cr (w)) - 0, for E € B[0.oo] and F e B(S) we have 

fi a (ExF) = P a (cro e E, x ao e F) = 0, if € F; P a { ct q e E), if e F. 

Therefore form Theorem |2 with cr = cr , we have 

r 

4-0 
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59 



t 

P(t, a, -E) = Q(t, a, -E) + J P(t- s, o, -E)fx a (ds), 

Since a > 0, E e B(0, oo) and all continuous paths starting at a and 
going into -E pass through o, Q(t, a, -E) = 0. Also P(t - s, o, E) = 
P(t - s, o, -E). Therefor, subtractiong, 

P(t, a, E) - P(t, a, -E) = Q(t, a, E) = P a {x t € E, t < ctq) 

i.e., J [N(t, a, b) - N(t, a, -b)]db - P a (x t € E, t < cr ). 

E 

Remark . P a (x t e E and t < cr ) = P a (x f e E and x s > 0, 
< s < t). 

Example 2. 

a 

P a (x s >0,0<s<t) = 2 f ——e- ei%t d% = P (\x t \ < a). 

J V27r7 


Put E = (0, oo) in Example ffl Then we get 73 

P a (x s > 0,0 < s < t) = —=[e —-e^~ }db 
Jo yfhtt\ I 

J() V27Tf 

- P (\x t \ < a). 

Note that if a > 
P a (x s > 0, < s < f) = P a (o- >t) = 

- P u ( min x s > = P a I min x s > -a 

\0<s<t I \0<s<t ) 

= Po ( max x s < a). 

\0<s<t I 

The following important theorem which follows easily from Theo- 
remfflgives what is called Dynkin's formula. 
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Theorem 3. If E a {cr) < oo and u e S>{^), then 

E a (J &u(x,)dt\ = E a (u(Xo-)) - u(a). 
Proof. From Theorem [fl 



uia) = E a (J 



e- at f{x t )dt \ + E a {e- a(T u(x <T )). 



74 Also 

fixt) = u{x t ) - <£u(x t ). 



Therefore 

u(a) - E a e~ at {au{x t ) - u(x t ))dt^ + £' a (e _a!<r (M(x -)). 
Letting a — > 0, we get the result. □ 

7 Blumenthal's 0-1 law 

Let M denote a strong Markov process. 

Theorem 1. If A e B 0+ (= f| B e). then P a (A) = 1 or 0. 

e>0 

Proof For P a (A) = P a (A, w e A) - P a {A, w+ e A) 

= E a (A : P XQ (A)) = E a (P a (A) : A) = (P a (A)f 

□ 

Theorem 2. Iff(w)sB 0+ , then P a {f = E a (J)) = 1. 

Proof. Since / € Bo+, / is bounded. From Theoremffl 

P a [f>E a (f)] = lorO. 

Obviously it cannot be 1, since then E a (j) < E a (f). Hence P a [f > 
Eaif)] = 0. For the same reason, P a [f < E a (f)] - 0. Hence P a [f - 
E a (f)] = 1- □ 



8. Markov process with discrete state space 
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We consider the following 

Example. Let <p(t) be a function of t, positive and increasing for t > 0. 
Let x t be a real valued strong Markov process. Consider 



By Theorem Q] P a (<p) = 1 or 0. If P a (<p) = 1, we say that tp € W E 
(the upper class) and if P a (tp) = 0, we say that <p € H a (the lower class). 
Wiener proved that for the Brownian notion, 



These results have been made more precise by P. Lavy, Kolmogorff 
and Erods P. Levy's theorem is that 



8 Markov process with discrete state space 

Let M be a right continuous Markov process with discrete state space 
5 . Since 5 satisfies the second countability axiom, it is countable. We 
denote the elements of S by (1, 2, 3, . . .). Since S is discrete, B(5) = 
C(S ) and W consists of the set of all step functions before their killing 
-time. M is a Markov process because H t C(S) c C(S). 

Let T a = inf (t : x t ± a) = inf(? : x t € G) where G - (S — {a}) U {oo}. 
T a is called the, first leaving time from a. Clearly r a < cr^. r a has the 
following properties: 

1 . T a is a Markov time. 




tp(t) = n and ip(t) = t^ £ e £ a for every e > 



ip(t) € (1 + c) ^2t log log l/t e<W a , c> 

X t ,c<0. 



For, 



{t u >t) = (x s = a for all s < t) 
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- (x r = a for all r <t,r rational) € B t . 



Note that 

(j a > t) - (x s - a for all s < t) 

- (x r - a for all rational r < t and x, - a) e M t . 

2. P a (T a >t) = where — = E a (T a ) 



Indeed we have 

P a (T a >t+s) = P a (j a > t, T a (wt) > S) 
= E a (T a > t,p Xt (T a > S)) 

- E a (T a > t, P a (r a > s)), since x, = a, 

= Pa(Ta > t)P a (T a > s) 

Therefore, if tp(t) = P a ija > t), then <p(t) is right continuous, as is 
easily seen, < <p(t) < 1 and ip(t + s) - (f(t)ip(s). Further 

<P(0) = P a (r a > 0) = P a (w :xo=a) = l. 

If tp(t) = for some t > 0, then tp(t) = (<p(t/n)) n = and so we 
should have tp(t/n) = for all n, and by right continuity, (p(0) = 0. 
Therefore < tp(t) < 1 for all t. Thus 



If p a = 0, then <p(t) = 1, i.e. P a (j a > t) = 1, i.e. P a (j a = oo) = 1 



If p a > 0, the map w — > T a (w) induces the mesure p a e Pat dt. 
Therefore 



Pa 



(pit) = e 



< p a < oo. 



and so 





Pa' 
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3. x T[i and r a are independent with respect to P a . 
Indeed, noticing that T a (yv) = t + T a {w+) if T a {w) > t, we have 

P a (j a > t,x Ta sE) = P a (r a > t,x t+Ta(w +){w) e E) 
- Pa(r a > t,x Ta(w *)(w*) e E 
= E a (j a > t,p Xl (xT a e E)) 
= E a (T a >t,P a (x Ta eE)) 
= P a (x Ta e E)P a (j a > t). 

We now determine the generator. From Theorem [Q 

u(a) = Ea( [ f o ° f^t)e~ at dt\ + E a { e - ar "u{x Ta )) 
Since w(t) = a for t < T a (w) and r a , x Ta are independent, we have 
u{o) = E u If (a) " e~ at dtj + E a ( e - aT ")E a (u(x Ta )) 
= f(a)E a I + E a (e- aT ")E a (u(x Ta )) 

/-■oo j _ „-af 

-/(a) £~^ c,t Padt + E a (u(x Ta )) e- at e-^p a dt 

Jo a Jo 

/(a) . 17 t t « 

+ -+^ fl (M(*T a )). 



A* + a Pa 



Let now 

TaZ; = ^a(*r a = b). 

Then 

E a (u(x T J) = ^ n ab u(b). 

beS Voo 

Since w(oo) is by definition zero, 

f(a) , Pa _ 
cv 

beS 



u(a) = + > n ah u{b). 

p a + a Pa + a j~i 
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From the last equation we see that u = implies / = 0. Therefore 

arc = {/ : / = oi- 

Also from the above we get 

au{a) - f(a) - n a bu(b) - p a u(a) 



beS 



and hence 



Sfw(a) - p a 



= Pa 



n a bu(b) - u(a) 



KbeS 



^ l n a b(u(b) - u(a)) - n aco u{a) 



KbeS 



since £ n ah + n aoo = 1. 
fees 

Remark. It is generally difficult to determine ^ = S>{^). We can also 
find ^ from Dynkin's formula as follows: 



u(x t )dt\ = E a {u{x T J) - u(a). 



Therefore 



Wu(a)E a I dt \ = y n a bu{b) - u(a) 



beS 

i.e., ^u{a)E a {T a ) = £ n ab u(b) - u(a) and since E a (r a ) = l/p a , we get 

b€S 

the result. 

Example. Suppose that n a b - expect for b = a ± 1 or b = oo and let 

7Ta,a+l = Pa, ^a,a-l = V a , 7T aoo = A a \ - fi a - V a . 

This process is called the birth and death process. We have 

^u{a) = p a (ju a u(a + 1) + v a u(a - 1) - u(a)) 

= Pa [p a (u(a + 1) - u(a)) + v a (u(a - 1) - u(a)) - A a u(a)] 

In this particular case we can derermine which will depend on 
the behaviour of p a , fi a and v a at a = oo. 
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9 Generator in the restricted sence 

In case of the generator denned previously there was some ambiguity 
so that Wu(a) had no meaning unless we took a version of &u. We shall 
now aviod this ambiguity by restricting the domain of the generator; we 
can then speak of Wu(a). Before doing this we prove some theorems 
on the domain of the new generator. We first define the function space 
9{S). 

Definition (). Let y t , t > 0, be a random process on a probability space 
Q(B,P). We say that y t tends to y essentially (P) as t I to, in symbols: 
y t > y, if for any countable t-set C with to e c, 

essAP) 

pi lim y, =y\ = 1. 

\teC,t^t J 

Let M = (5, WP a ) be a strong Markov proces. We make the follow- 81 

ing 

Definition (). @(S) = {/ : / e 38(S) and for every a, f(x t ) * 

ess.(P a ) 

f(a), as t i 0}. 

Theorem 1. S>{S) dc (S). 

Proof. Clear. □ 
Theorem 2. G a B(S) c 9(S). In particular, G a @{S) c @(S). 

The proof depends on the following Lemma, the proof of which can 
be in Doob's book (p. 355). 

Lemma (). Let z be a random variable on a probability space Q(B,p), 
with E(\z\) < oo. Let B f c B, < t < oo, be Borel algebras such that if 
t < s, M t c B s . Then, ifM 0+ = f| B f) we have 

f>0 



E(z/B t ) > E(z/B 0+ ). 

ess. (P) 



66 



2. Srong Markov Processes 



Proof of Theorem |2l We prove first that 

Gafixt) = e at E a (z/B t ) - e at f e~ as f(x s )ds 

Jo 

with P a probability 1, where z = e~ as f(x s )ds. Indeed, if B t € B f , by 
the Markov property, 

E a (G a f(x t ) : B t ) = E a \E A If e~ as f{x s )d^ : B r J 

= EaU e- as f(xM))ds : b\ 

Since G a f(x t ) € B,, by the definition of conditional expectation we 
have 

G a f{x t ) = e at E a If e- as f(x s )ds/B t 



= e at E a \ e~ as f{x s )ds/M t \-e 



f E a ^f e- as f(x s )ds/E^j 



= e at E a (z/E t ) - e a 



I 



e~ as f(x s )ds 



M> 



Since J Q e as f(x s )ds € B ( , the conditional expectation of J Q e 0,5 

f{x s )ds is J Q e f(x s )ds with probability 1. Using the lemma, there- 
fore, 

G a f(x,) * E a (z/B 0+ ). 

ess (P a ) 

From Blumenthal's 0-1 law, if EeEo+, P a {E) = or 1. Hence 

E a (z/B 0+ ) = E a {z) = G a f(a). 
This proves the theorem. 
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Theorem 3. If f € &{S), f{x t ) is right continuous with respect to U- 
nonn. 

Proof. Since / e 9{S), if t n -> 0, P a (f(x t ) -> /(a)) - 1, so that 
E«(l/(*t) - -> as n -> oo. 

Now 

£«(!/(**«) - /fe)l) - - /(*o«))i) 

= E a (E Xs Qf(x t ) - f(xo)\)) -> as n -> oo. 

This proves the result □ 

Theorem 4. //Fe a«J G a / - 0, then f = 0. 

Proo/ Note that if g^/ = for some /?, Gpf = for all /?, from the 
resolvent equation. From Theorem |3 

H,f{a) = E a (f(x t )) -> f(a) as f -> 0. 

Now 

- aG a f{a) = a I e~ a, H t f(a)dt 
Jo 

= I e~ s H s / a f(a)ds — > /(a) as a — > oo. 
Jo 

Q.E.D. □ 

Theorem 5. Iffs^(S), 

P a (i /(jc,M* -» or f -> oj = 1. 



Proo/ Put y(>, w) - /(x,(w)) - /(a) and let C - {2^, it, n = 1, 2, . . .} 
be the set of dyadic rational numbers. Then from the definition of S${S), 

lim sup w)| - 0, 

ssC,Q<s<t 



84 
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[2" s] + 1 

for w € fii, with P a (Qi) = 1. Put <p„(s) - — . Then <p n (s) -> v 

for every s. From Theorem |3 



2" 



J ^(lyO^O), w) - y(s, w)\)ds as « oo, 
Jo 

i.e., y(^,j(i), w) — > y(s, >v) in L'-norm on L'([0, 1] x W). Therefore, 
there exists a subsequence, </f n (s) = <Pk„(s), say, such that y{i]/ n {s), w) — > 
y(s, w) for (s, w) e A, say, with (m X P„)(A) = 1, m x P a denoting the 
product measure on [0, 1] x W. Now 

so that m(s : (5, w) e A) = 1 for w e Q. 2 , P a (^2) = 1- Let Q.i n Q 2 = 
Then if w e Q, w e H 2 so that 



If If' 

- y(s, w)rfs = lim - y(ifr n (s), w)ds 
t Jo " * Jo 



< lim sup y(s, w) — > as ? — > 0, 

" «eC,0<.s<f 

85 since vreO]. 

Definition of generator in the restricted sence. Let M be a strong 
Markov process. Consider the restriction of G a to &{S). We shall de- 
note this also by G a . □ 



= G a B(S ) z's indepentent of a. (We can therefore denote 
The proof is similar to that is the case of the generator defined ear- 



Theorem 6. 

R a by R.) 



lier. 

Theorem 7. G a : @(S ) — > R is 1 : 1 araci 

Proof. Since G a / = implies / = 0, G a is 1 : 1. Let us write & a = 
a-GZ 1 . □ 



Theorem 8. @ a is independent of a. 
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This is obvious. 

Definition (). <£ - a-G~ l is called the generator in the restricted sence. 

Since G a is 1 : 1, Sfw e B(S). 

Theorem 9 (Dynkin's formula). Ifu e and cr a Markov time with 
E a (cr) < oo, then 



VO / 
proof as before. 

Theorem 10 (Dynkin). If^u is continuous at a and if&u(a) + 0, then 

r/? , . .. E a (u(x Tu )) - u(a) 
Wu(a) - hm 

Ula E a (ju) 

where U denotes a closed neighbourhood of a and Tu is the leaving 86 
time for U, i.e. t\j - inf {t : x t € (S - U) U oo}. 

Proo/ Since Sfw(a) ^ 0, we may suppose that &u(a) > a > 0. Let U 
be a closed neighbourhood of a such that for b e U, Wu(b) > a/ 2. Let 
T n = T(/ A «; then E a {T n ) < oo and 



If T < t'\ w(x t ) e U and ^w(x ? ) > a/2. Hence 2\\u\\ > \E a (j n ). If 
follows that E a (Tu) < oo. Therfore 



VO / 

Since ^M(a) ia continuous at a, sup foeu \Wu(a)-&u(b)\ — > as t/ J, a. 
Therefore 



a 







as f/ 4 a 



□ 
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Theorem 11. If u e = R, f/iera g/ve« any sequence of Markov 

times {cr n } such that cr n > 0, we can find a sequence {t„} of Markov 
times, < t„ < o~„ swc/i 



?w(a) = lim 



E a (u(x Tn )) - u(a) 



E a (T n ) 



seen 



Proof Let # £ (/) = inf : ± jT f f{x s )ds - /(a)| > erj. If is easily 

that e (/) is a Morkov time, and since f(x s )ds — > /(a)) = 1, 

P«(0 e (/) > 0) = 1. Let now 

Tn - Oi/ni^U) A cr„ A 1. 

Then P a (r„ > 0) = 1 and < £ a (r„) < 1. Therefore 
E a I J" &u{x t )dtj = E a {u{x T J) - u(a). 



We have 



E a (u(x T J) - u(a) 



1 



E a [T n ] 

1 



Ea(T„) 



1 

— T„ 
1 



f 

Jo 



(Sf w(jct) - ^u{a))dt 



- . . , :£ a (T„) > 0as« -> oo. 

Properties of generator in the restricted sense: □ 

Theorem 12 (Mean value property). Let U be an open subset ofS and 
Tfj the leaving time from U and u € @C&). 

(1) If u(a) - E a (u(x Tu ))for every a e U, then %?u(a) = in U. 

(2) Conversely, ifE a (ju) < oo, &u(a) = in U, then 



u(a) = E a {u{x Tu ))for every a e U. 
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Proof. (1) If u(o) - E a (u(x Tu )) for every a e U, then u(a) - E a 
(u(x Tu )) for every a e S . For if a U, P a (Tu — 0) — 1. If follows 
that E a (u(x Tu )) = u(a). Noting this, let t be a Markov time < t\j. 
Then since t\j - t + tu(w+), we have 

u(a) = E a (u(x Tu )) = E a (u(x T+Tu(yv ^(w))) 
= E a (u(x Tu(w ^(w^))) 
= E a (E XT (u(x Tu ))) = E a (u(x T )). 

Now we can choose a sequence of Markov times t„ < t\j so that 

E a (u(x T )) - u(a) 
&u(a) = lim n " — - 0. 

" E a (Tn) 

(2) If E a {ru) < oo we have from Dynkin's formula 

E a \ f ^u{x t )dt\ = E a (u(x Tu )) - u(a), 



so that if Wu(a) - for a e U, Wu(x t ) - for t < tq and we get 89 
the result. 

□ 

Theorem 13 (Local property). Let u, v e 3>(W) and u = v in a closed 
neighbourhood U of a. Suppose that there exists a Markov thime cr such 
that P a (o~ > 0) = 1 and P a (x t is continuous for << cr) = 1. Then 

<gu{a) = &v(d). 

Proof. Let h - u — v. Then h(b) = for b e U. Let r = cr A Tu- Then 
since x t is continuous for < t < t, x r e U so that E a (h(x T )) - = h(a). 
Now 

eau \ v E a (h(x T J) - h(a) 
&h(a) = hm — = 0, 

n^oo E(T n ) 

since t„ can be chosen so that t„ < cr A Ty- □ 



Section 3 

Multi-dimensional Brownian 
Motion 

We have already studied one-dimonsional Brownian motion. We shall 90 
now define ^-dimensional Brownian motion, determine its generator and 
deduce the main result of Potential Theory using properties of the k- 
dimensional Brownian motion. 

1 Definition 

We first define ^-dimensional Wiener process. Let x(t, w) = (xi(t, w), i = 
1 , 2, . . . , k) be a k-dimensional stochastic process on a probability space 
Q(P). x(t, w) is called a k-dimensional Wiener process if (1) its compo- 
nents Xi(t, w) are one-dimensional Wiener processes, and (2) jc,-(f, w), 1 < 
i < k, are stochastically independent processes. 

It is easy to construct a ^-dimensional Wiener process x(t, w) on 
Q.(P) from a 1-dimensional Wiener process A) on A(0. It is suffi- 
cient to take O = and P - the product probability Q k , and define for 
w = (Ai,...,A k ), 

x(t,w) = ({(t,Ai),...,t(t,Ak)). 
We now study the ^-dimensional standard Brownian motions. Let 
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3. Multi-dimensional Brownian Motion 



S - R k , W = the set of all continuous functions into S and define 
P a (B) = P[a + x(.,w) e B]. 

91 Here a = (a\, . . .,at)- It is easily verified that M = (S, W,P a ) is 
a Markov process M is called the k-dimensional standard Brownian 
motion. The transition probability of the process is 

P(t,a,E) = \ N k (t,a,b)db, 

JE 

where Nu(t, a, b) - N(t, a\ , b\) ■ ■ ■ N(t, au, b^) 

Since, for / e C(S), 

H t f(a) = J e^ l2t f{a + b)db, \b\ 2 = b\ + ■ ■ ■ + b\ 

is also in c(S), M is a strong Markov process. 

Let 6 denote the group of congruence (distance-preserving) trans- 
formations of R k . If O e 9, then O indues a transformation, which again 
we denote by O, of W — > W defined by 

(Ow)(t) - OW(t). 

O carries measurable subsets of W into measurable subsets. For any 
subset L c W, we define 

OL = (Ow:we L). 
The following facts are easily verified 
(0.1) P(t, Oa, OE) = P(t, a, E) 
(0.2) P 0a (OB) = P a (B). 

92 If O e 9 is a rotation around a, i.e. if Oa = a, P a (OB) - P a (B), so 
that O is a P a -measure preserving transformation of W onto W. 
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2 Generator of the ^-dimensional Brownian motion 

Let @ - 3>{R k ) be the space of all C°° function with compact supports. 
For ip e put 

6(t,a)=H t (p(a), 

and 

if/(a) = \ff(a, a) - G a <p(a) = J e' at 9(t, a)dt. 

Now 

9{ua) = \ vk^ e ~ m2 ' 2t<p{a+b)db 

R k 

= f -p^e-^'^ia + b^db, 

and a simple calculation gives 
89 1 

— = -A9, 9(0 + a) = cp(a). 
8t 2 

Taking Laplace transform, the last equation gives 
(a - jA)iff = <p. 

In order to show that iff is the unique solution of this equation, it is 

? 1 
enough to show that if iff e C , iff(a) — > as \a\ — > oo and (or - - A)tA = 0, 93 

then iff = 0. To prove this, suppose that ift(a) > for some a. Then since 
iff (a) — > as \a\ — > oo, the maximum of is attained at a finite point 
ao and 

(/'(flo) - max ^(a) > 0. 

Therefore 

AiKa ) ^ 0, 

and hence 

(a - -A)iff(a ) > 0. 
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3. Multi-dimensional Brownian Motion 



Thus if/(a) < 0. Replacing if/ by -if/, we see that if/ = 0. This proves 
our contention. 

Now, let / e &(R k ). Then 

u(a) = G a f(a) = J G(a, \b - a\)f(b)db, 

where 

/~oo e -at-\b-a\ 2 jit 

G{a, \b-a\= dt. 

Jo (Int)*' 2 



Note that G(a, \b - a\) is continuous in {a, b). It is immediate that 
u e 38(R k ) and we can consider u as a distribution in the Schwartz sense. 
Then by the definition of the derivative of a distribution, for any ip e 

a - — A J w(c£ ) = | n(a)[a -A\ip(a)(la 



94 where 



= J u{a) [a - ji 
Jj G{a, \a - b\)f(b) {a - ^ aJ <p{a)da db 
J f{b)db J G{a, \b - a\) [a - j A J ip{a)da 
J f(b)if/(b)db; 



if/(b) = ^ G{a,\a - b\)[a - ^A\ipUi)d«. 



If 6 = [a - \ A) cp, then G e S> and 
and from the above we get 



a - - A I if/ - 6 - I a - -A I <p, 



and hence if/ = <p. 
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a-U)u(<p) = J f{b)if{b)db, 



Thus 



and this means that the distribution [a - ^ a| u is defined by the function 

/. (Of course, any function equal to / almost every-where defines the 
same distribution.) 

What we have above also shows that if u = then the distribution 

|a - ^-a| u - so that / = a.e. Hence 

5R = {/:/ = a.e.) . 

Let M - \u : u, Au e 38(R k ), Au is the distribution sense J 
= |m : u € 38(R k ) and the distribution Au is defined 

by a function in @(R k )j. 
We see form the above that & c Now suppose m € Then 95 
u e &(R k ) and Am is defined by a function in &(R k ). Let (a - j^ 11 
be defined by / e 3S{R k ). Put G a f - v and from the above we see that 

(a - 2 A) v * s defined by /. Hence (au\ - -Ami) - where wi - u-v. 
We prove that wi = a.e. Now 

for every 9? e 5${R k ), so that 

^Mar - -Aj (p(a + b)u\(a)da - 
for every ^ e $>{R k ). Also 



. b)\dadb 



= J G(a, \b\)db J \ Ul (a)\\(a-jAj(p(a + b)\da 
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= J G{a,\b\)db J \ui(a-b)\\\a-^Aj<p(a)\da 
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a<EK 

<M J G(a, \b\)db, 
where K is the compact set outside whish <p is zero and 
M = (diam .K). Sup \u(a - b)(a - ^A)<p(a)\. 
Therefore, 

= ^ G{a, \b\)db ^ |or - -Aj <p(a + b)u\(a)da 
= ^ u\(a)da ^ G{a, \b\) - -Aj <p(a + b)db 
- J" U[(a)da(p(a). 

Hence u\ - a.e. Thus 

St = [u : u,Au € 3S(R k )} 

and Zfu = -Au in the distribution sense. 
2 

3 Stochastic solution of the Dirichlet problem 

Let U be a bounded open set and / a function which is bounded and 
continuous on the boundary dUofU. The problem of finiding a function 
h(a : f,U), defined and harmonic in U and such that h(a : f,U) — > /(£) 
as a — > £ from within £/, is called the Dirichlet problem. h(a), if it 
exists, is unique and is called the classical solution. The definition of 
a solution can be generalized, in various ways, so as to include cases 
in which the classical solution does not exist. The generalized solution 
will still be harmonic in U, but will tend to the boundary value /(£) in a 
slightly weaker sense. 
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The stochastic solution, which we shall discuss, gives one way of 
defining a generalized solution. Let 



By definition, u(a) - u(a : f,U) - E a {f{x Tu )) is the stochastic 
solution of the Dirichlet problem with boundary value /. We shall see 
that the stochastic solution is identical with the classical solution, in case 97 
the latter exists. 

We first establish some results on r\j. 

Theorem 1. P a (j u <oo) = \ifJJisa bounded domain. 

This is a corollary of the following stronger 
Theorem 2. 



Proof. Since P a [B + a] = Pq[B], we can assume that a - 0. Further, 
since t u > r v for U D V, we can assume that U is the sphere T = 
{x : \x\ < r}. Let u € be such that <$u has a version satisfying 



Let T n = tu A n. Then t„ is a Markov time, and Eq(t„) < n < oo. 
Therefore, from Dynkin's formula, 



For < t < r n ,x t € T and &u(x t ) >€q and £q Eo(t„) < 2\\u\\ 



tu = first leaving time from U - inf {t : x t £ U} 



E a [ru] < oo, ifU is bounded . 



Wu(a) >€o in T for some £o> 0- For example, if u(a) - -e M l4r2 , then 

1 -1 [ k \a\ 2 ] 

Wu(a) = -Au(a) = — - u(a) > 0, if \a\ < r. 




Therefore 



E (t) - lim E (r„) < 



2\\u\\ 



< oo. 



□ 
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Theorem 3.I/U is open and bounded, if f is continuous on dU and if 98 

there exists a classical solution h(a) = h(a : f, U), then 

u(a :f,U) = h(a : /, U) 

Proof. For any open subset V of U such that V c U, let h denote a C°° 
function which vanishes outside U and such that hy = h or V. Such 
a function can easily be constructed. Then hy e 3>(W). Since V is 
bounded, E q (tv) < 00 and Dynkin's formula gives 



yh v (x t )dt\ = E a (h v (x Tv )) - h v (a). 



For t < T V ,x t e V and &h v (x t ) - jAh v (x t ) - ^Ah(x t ) - 0. If 
Ty < oo, x Tv € dV so that hv(xr v ) = h(x Tv ), and since V is bounded, 
Pu(tv < °°) - 1- Therefore E a (h(x Tv )) - hy(a). Hence, if a e V, then 
E a (h{x Tv )) - h(a). 

Now let be an increasing sequaence of open subsets of U such 
that V n c U and V„ t U. Then r„ = lim ry . Since P a (T M < oo) = 1, we 

n— oo 

have with Pa-measure. 1, 

/(x Tu - lim /i(x r ) 

17 — > OO " 

u(a) - E a (f(xrJ) - lim E a (h(x T )) - A(a) 

for every a eU. This completes the proof. □ 

A natural question is "When does the classical solution exist?" The 
simplest case is that of a ball T - T{aQ\ r). For a € T, let a' denote the 
inverse of a with respect to Y, i.e., 

r 2 

a ' = a o + m ^ a ~ a o)- 

||a - a || 2 



Let 
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1 1 



- log log log 

\b - a\ \b-a'l \a - <2q\ 



k = 2, 



and 



U r (a,^ = --^-^-G(b,a) 

k - 2 dpi, 



xr k - 1 for k > 3, 

6=f 



U r (a,^ = -^-G(b,a) 

OPb 



r*- 1 for 1 < k < 2, 



where denotes the derivative in the radial direction of Y. Then, if 

OPb 

f is defined and continuous on the boundary of the ball, and if 9{d^) is 
the uniform probability distribution (i.e. the normed rotation invariant 
measure on the boundary of T), the classical solution is given by the 
Poisson integral 



h(a:f,U)= f n T (a,&M)6(dO. 
Jdr 

The concrete form of ITr(a, £) is not of importance to us. The only 
fact we need is 

Theorem 4. IfT, V are two concentric balls, with radii r,p(r > p) ; then 



and 



c\ - min rir(a,£) 



C2 = max rir(fl , ,£) 

a€?,£edT 



depend only on p/r and c\ , c^ — > 1 as p/r — > 0. 
The hitting measure Uu(a, E) of E is defined as 
Uu(a,E) - P a (x Tu eE),Ee E(dU). 

Clearly 

u(a:f,U) = J Uu(a,dOM)- 
r 

We have the following 
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Theorem 5.I/T is a ball, for a € T we have 

n r (a,d%) = n r (a,£)0(d£) 

= the harmonic measure on dT with respect to a. 

Proof. The proof is immediate since, from the above, for every contin- 
uous function / on dT, 

J(a,d&m = J n T (a,oemf(£), 

dr ar 

and hence the same equation holds for all bounded Borel functions on 
dT. □ 

Using the notation of Theorem 0J we have 

Theorem 6. 

c x 0{E) < U r (a,E) < c 2 8(E). 

We now proceed to prove that if the boundary of a bounded open set 
U is smooth in a certain sense, then the stochastic solution is also the 
classical solution. 

Definition (). Let £ e dU, where U is an open set. If there exists a cone 
C c U c , with vertex at ^ then £ is called a Poincare point for U. 

Theorem 7. If £ is a Poincare point for a bounded open set U, then 
for any €> and for any neighbourhood T of there exists a smaller 
neighbourhood Y' of ^ such that 

P a {x Tu $ T) <€ 

for any a eF n U. 

Proof. Let C c U c be a cone with vertex at We can assume that T 
is a ball of radius r such that C — T + (f>. Let T n be the ball with the 
same centre as T and radius r n = a n r, where a < 1 is to be chosen 
subsequently. Let r„ be the first leaving time from T n . If x Tu g T, rp < 
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t u and since P a (T n ^ T) = 1 for any a e T we have x Tn e £/. Therefore 
x Tn £ C. But x Tn e 3r„ so that x Tn e (5T„ - c. Therefore for any a e T n , 

P a (x Tu <t r) < P a (x r „_! € 3r„_i - C, . . . , x Tl e STi - C) 
= ^o(-«t b -i e 5T„_i - C, . . . , x T2 e d 

T 2 - C,x Ti((0t2+) (oj+) e dTi - C) 

since t\ - r 2 + Ti(w+ 2 ). Also since r, < t 2 , for i > 2 we have 

*r, = x(t ; (w),w) = x(Ti(w),W~ 2 ) 

= x(n(w; 2 ),w") e ^ T2 c ^ T2+ . 

□ 

Using the strong Markov property we have 

P a (* TB £ T) < £ a (x Tn _j e 5T„_i - C, . . . , x T2 e d 
r 2 -C:P Xr2 (x Tl edTr-C) 
< c 2 #P a (x r „_, € dlVi - C, . . . , x T2 e dT 2 - C), 

if a e T„ n U. where = d(dT\ - C) < 1. Since depends only on 

the solid angle at the vertex 0(dTi - C) = 0((5T 2 - C) = = 

0(<9r„_i - C). We have repeating the argument, 

p a (x TV *d< {c 2 er l 

Since c 2 — > 1 as a — > 0, we can choose a so small that c 2 < 1. 
Now choose « large enough so that (c 2 9) n ~ l <e. 

Theorem 8. For any open set U and any bounded B or el function f on 
dU, 

u(a) = u(a : f, U) 

is harmonic in U. 

Proof. Let a e U and T be a ball with centre at a and contained in U. 
Then since tu - Tp + tj/(w^, we have 

u(a :f,U) = E a (f(x Tu )) = E a {f{j^ ,(<))) 
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= E a {E Xrr {f{x Tu )) 
= E a (u(x Tr )) 

= J Pa(x Tr € d£)u(g) 

103 and the last term is harmonic for a e Y. This proves that u is harmonic 
in a neighbourhood of every a e U. Hence u is harmonic in U. □ 

Theorem 9.I/U is a bounded open set such that every point of U is a 
Poincare point and if f is continuous on dll, then the stochastic solution 
u = u(a : /, U) is also the classical solution. 

Proof. By Theorem [SJ u is harmonic in U. Let £ € dll. Since / is 
continuous, we can choose a ball T = T(£) such that \f{rf) - f{<;)\ <€ for 
x] e T. By Theorem we can choose P so that 

P a (x Tu t T) <e,ae V. 

For a e T', 

\u(a) - f({)\ < E a (\f(x Tu ) - f(&\) 

= E a (\f(x Tu )-M)\:x Tu eY) 

+ E a (\f(x Tu ) - f(g)\ : x Tu $ Y) 
<e +211/11 e . 

□ 

104 Remark . When k = 1 , harmonic functions are linear functions. If 
(01,02) is an interval and f{a\),f(a2) are given; then 

ai — a a — a\ 

h{a : /,(oi,o 2 )) = /(01) + f(a 2 ) 

@2 ~ cl\ ai~ a\ 

- u(a; f, (ai , o 2 )) 

= f(fli)P a {x T{aiai) = ai) + f(a 2 )Pa(x T(aia2) = a 2 ) 
= f(ai)P a (o~ ai < cr a2 ) + f(a 2 )P a ((r a2 < cr ai ), 
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where cr aj ,i = 1,2, is the first passage time for a,-, / = 1,2. Since / is 
arbitrary, 

P a (o- ai < (Ten) ~ 



a 2 - a\ 
a- a\ 

P a (o- a2 < o- ai ) = , 

a 2 - a\ 

We have seen that if U is bounded and open and if every point of 
dU is a Poincare' point, the Dirichlet problem for U has a solution. We 
now define a generalized solution. 

Suppose that U is open and bounded and that / is bounded and 
continuous on dU. Let {£/„} t U be an increasing sequence of open sets 
with U n c U n+ \ and such that every point of dU n is a Poincare point. 
Let F be a continuous extension of / to U and F n = FTdU n . Denote 
the classical solution for U n with boundary values F n by h(a;F n , U n ). 105 
Then lim h(a;F n , U n ) is, by definition, the generalized solution (in the 

n—oo 

Wiener sense) of the Dirichlet problem with boundary values /. We 
have of course to show that the limit exists and is independent of the 
choice of U r and of F. 

Theorem 10. For a bounded open set U,u(a;f, U) is the generalized 
solution. 

Proof. We have only to show that h(a : F n , U n ) —> u(a : f,U). In fact 
since t m „ t t u < oo with probability 1, 

h(a : F n , U„) = u(a : F n , U„) = E a (F(x Tun )) 
-» E a (F(x T J) 
= E a (f(x Tu )) = u(a : f, U). 



□ 



Remark. u(a) = u(a : f, U) does not always satisfy the boundary con- 
dition lim u(a) = /(£) for ^ € dU. In §7 we shall discuss these 

a€U,a— >f 

boundary conditions. 
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4 Recurrence 

Definition (). A Markov process M is called recurrent if 

P a (x t e U for some t) = Pa{o- v < co) = 1 

for any a e S and any open U; otherwise it is called non-recurrent. 

We shall now show that the standard Brownian motion is recurrent 
for k < 2 and is non-recurrent for k > 3. 

106 Theorem 1. Let T\,Yi be the balls with centres ao and radii n, r2(r2 > 
n). If cf\ - crdY l ,o-2 = o" f 9r 2 a™ the first passage times for dl \ anddY^, 
then for a e T2 - f i, 



/ y -k+2_ r -k+2 
r r 2 
r -k+2_ r -k+2 
r l r 2 



Pa{cri < cr 2 ) 



,k > 3; 



n-n 



,k= 1; 



where r = \a - ao\. 



Proof. In fact, if U -T2-T\,dU - dFi Udl"^, and the function / which 
is 1 as dTi and as dl"^ is continouous on dll. Since every point in dll 
is a Poincare point, the classical solution h(a;f, U) - u(a;f, U) exists 
and 

p(a) = P a (cri < cr 2 ) = P a (x Tu e dTi) = u(a;f, U). 

The function given in the statement of the theorem is harmonic in U 
and takes the boundary value /. Since such a function is unique, we get 
the result. □ 

Theorem 2. Let Y = T(ao, r) be a ball with centre ao and radius r and 
107 let o"r be the first passage time for V. For c^f and p = \a - ao\, 



P a (o-r < oo) - 



\{rlp) k -\ k>3 
I, k<2 



Therefore k-dimensional Brownian motion is recurrent or not ac- 
cording as k < 2 or k > 3. 



4. Recurrence 
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Proof. Observe that cr T - o-qt for any path whose starting point is not 
in T. Let V = T'(ao, r') and cr' = crsr- If t < croo(w), then since w(t) is 
continous, F t - {x s : < s < t] is a compact set and hence we can find 
r' such that F D F,. Then cr(w) > f. It follows that 



Therefore 

Pa{o~T <oo) = P a (crr < lim cr') = lim P' a (cr r < cr'). 

r' — >oo r'^oo 

Now take r 2 - r' and cr 2 = cr' in Theorem [TJ and we get the result. 



Theorem 3.1fk> 3,P a (\x t \ -> oo as t -> oo) = 1. If k < 2,P a (w : 
(x s , s > t, is dense in R k for all t)) =1. 

Proof. Case k > 3. We can, without loss of generality, assume that 
a = 0. Let T„ = n and o~ n = ctqy,, ■ For any path w, \x t \ — > oo if and 
only if for every given « we can find s such that the image of [0, oo] by 108 

is contained in T° n . Therefore \x t \ -t* oo if and only if we can find n 
such that for every s > 0, the image of [0, oo] by w+ has a non-empty 
intersection with Y n and therefore if w+(0) £ T n , then cr n {w + s ) < oo. 
Therefore 

Po [W oo] = P [3 « such that for every 5 

> with w+(0) $ T„, o- n {w + s ) < oo] 

< V P [for every S > with w+(0) £ r„, cr,,^) < oo] 




lim cr' = oo. 



r' 



CXI 



□ 




< 




Po for every m > n, cr n (w^. ) < 



oo 



/I 



Now 



Po( for every m, cr„(mj m ) < oo) < P (cr„(wJ m ) < oo for some m) 

- E (P x (o-„ < oo) 
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I n \ 

= 1 — 1 — > 0, as m — » oo. 
\m) 



Case k < 2. Let T be any ball and crp = the first passage time for T. We 
have 

P a (o- r < oo) = 1 
for every a, so that for any t, 

P a (o-r(wt) < oo) = E a (P Xt (o- T < OO)) = 1. 

Now 

P a ( for every f, crCw^) < oo) = P a ( for every n, crr(w^) < oo) 

= 1. 

Let n, T2, . . . be a complete fundamental system of neighbourhoods. 
Then 

P a ( for every n, for every ?, cr rj> (w*) < 00) = 1, 

i.e., 

P a ((x s (w) : s > t is dense in R k )) - 1. 



5 Green function 

Case A: > 3. 

Definition (). Let U be a bounded open set. Then 



Gn(a,b) = : — — — 

\a-b\*- 2 J du \{-b\k- 



2 



is called the Green function for U, where H(j(a, d^) is the harmonic 
measure on dU with respect to a. This is the potential at b due to a unit 
charge at a and the induced charge on dU. 



5. Green function 
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As the limiting case, when U -> ^, we can define the Green func- 
tion (relative to the whole space R k by 

G(a, b) = 



\a - b\ k ' 2 ' 

110 Theorem 1. If f is bounded, Borel and has compact support, then 

rOO 

E a (j Q f(xt)dt) < oo and 

E a ( f f{x,)dt) = — f ^ b)db , where K = Am /T(- - 1) 
Jo K J \b-a\ k - 2 V 2 

Proof. It is enough to prove the theorem for / > 0. We have 
Ea [L /(X?) ^) = X Ea{f{Xt))dt 

/"•CO 

= I * I 

(2m) j 



= dt T e~—f{b)db 

Jo J** (2m) 2 

r r°° i \t-a? 

= f(b)db -e~—dt 

Jr" Jo (2m) 3 

r rw2-p 

J R * |fr - a\ k ~ 2 2U1 

= 2 r f(b)db 

K J Rk \b - a\ k ~ 2 
< oo, 

because, if T is a ball containing the support of /, 

db 



f (b-a) k ~ 2 ~ 11/11 f (b a) k ~ 2 
r r 



< oo. 



Theorem 2. Let v(a) - E a (£° f(x,)dt). Then v(a) e $(<&), 111 
-Av = -/ a.e., araci v(a) — > as \a\ — > oo 
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Therefore, if 

u(a) - J G(a,b)f(b)db, 
A u — —kf a.e. ( Poisson's equation ) 
and u(a) — > as /a/ — > oo. 

Proof. By Theorem^ v(a) is bounded and Borel. If 

GJ(a) = E a e- € ?fe)*J , 

we have 

v(a) = lim G E f (a) 
and the resolvent equation gives 

Gaf - G e f + (a- e)G a G e f = 0. 

Letting e— > 0, 

G a f - v + aG a v = 0, 

or 

v = G a (f + av) € 
Also, since ^v = av- G~ l v = av - f - av = -f, a.e., 

— Av - —f a.e. 
2 

□ 

112 Definition (). Let A be a bounded subset ofR k . Then 

S(A,w) = the Lebesgue measure of {t : x t (w) € A} 
is called the sojourn (visiting) time for the set A. 
From Theorem ^ we have 



5. Green function 
Theorem 3. 



E a (S(db)) 2 

= —G(a,b). 



db K 

Let now U be a bounded open set and / e 3$(U). Let 



vu(a) = vu(a; f, U) = E a 

Tu being the first leaving time from U. 
Theorem 4. 



I 

Jo 



f(x t )dt 



a\ k - 2 ' 



a) = W Gu(a,b)f(b)db. 
K Ju 

Proof. Extend / by putting / = in U c . Then 

^w = «.(jT/w*) = |/ oj ^ ) * 

by Theorem [fl Also 

- vu(a) + £ fl I f{x t {w + v ))dt 



= vu(a) + E a \Ex Tu | J" f(x t )dt 

= vu(a) + E a (v Q (x Tu )). 

= vu(a) + I 7rj/(a, dg)v (O 
JdU 



<9t7 



(a) + I f f 



W l&-fl fc - 2 
This gives the result. 
Theorem 5. vj/(a) satisfies 

-Av v = -f, a.e., 
and Vu(a) —* as a — > ^, £ a regular point ofdU. 
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114 



Proof. vjj(a) - vo(a) - E a (vo(x TlJ )). Since E a (vo(x Tu )) is harmonic in U 
and -Avo(a) = -/ a.e., we have 

-Avu(a) = -f, a.e. 



Further if £ € dll is regular, E a (vo(x Tv )) — > vo(£) as a — > £ and since 
vo(a) is continuous by Theorem [flvo (a) — * Vq(£) as a -> f . The result 
follows. 

Theorem 6. Let S (A/U,w) = the Lebesgue measure of {t : x t e A,t < 
Tu). Then 

E a (S(db/U)) 2 

^ = ^(^). 

As an example we compute vjj{a) for U = the open cube (0, l) 3 , k - 
3. Since every boundary point of the unit cube is regular (in fact every 
point is a Poincare point), v\j = as dll. Therefore v = vy{a) is the 
solution of 

-Av = —f and v = on dU. 
2 

Since v = as dU we can put 

v(x,y,z) = a/ m „ sin Z 7rxsinra7ry sinn7ix 

/+m+n>0 

Then 

2"' 2 



1 7T 2 V~^l 2 9? • 7 • 

— A v = — ^ (1 +m + n )a[ mn sm Inx sm mny sm nnz 



t+m+n>0 
If 



f{x, y, z) - ^ bi mn sin Inx sin ra7ry sin nnz, 
we have therefore 

2/?/m« 



n 2 (l 2 + m 2 + n 2 ) 



5. Green function 
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- 16 

n 2 {l 2 + m 2 + n 2 ) 

I I I /(£> V' sm ^ s i n mn t in rm^d^drjdn 
Jo Jo Jo 

This gives 

Zsin /7r^ sin Inx sin m7T7/ sin wury sin nn£ sin «7rz 

r + m z + n z 

Hence 

„ , 32 v-i sin /7r£ sin /7rx sin thjiti sin nmy sin H7rZ' sin H7rz 

n / — ' l 2 + m 2 + n 2 

in the distribution sense. 

Case A; < 2. 

We cannot apply the preceding method to discuss the Green function 

f CO 

for k < 2 because E a { J Q f(x t )dt) may be infinite even if / has compact 
support. We therefore follow a different method. 

Let T = T(o, r) be a ball. If u € C°°(R 2 ), [i.e. compact support and 
C°° ] then u e S>(^) and Dynkin's formula gives 

E a I I ^-Au(x t )dt) - E a (u(x Tr )) - u(a) 



2 2 



n r (a, g)u(g)6(dg) - u(a), n T (a, £) = , 
,*r I" - £-1 J 

2 1 



r G(q, 6) 

Jar ^« 



|ai> - r 

xru(£)9{d%) - u(a), Gy{a, b) - log ■ 



b ; |fl - fe| 



\ ^-G T {a,b)l-Au{b)2db. 
Jr 2tt 2 
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If <p e C°°(7? 2 ) and v(a) - i J r G T (a,b)<p(b)db, then ±Av = 95 There- 
fore we have for any <p e C°°(R 2 ), 



( t 



r (p(x t )dt \ 

vo 



= - r gtco, 

t Jr 



b)(p(b)db. 



It follows that the same equation holds for any / e S(R 2 ), i.e., 
( r r 



E a 



J f{x,)dt 
vo 



if G(a, 



b)f(b)db. 



Now let t/ be a bounded domain, U c T, a ball. Then 









= E a 


Jf(x t )dt 
















= E a 


J f(x t )dt 






.0 





7 A Extu [L 



f(x t )dt\\, 



so that 



£ fl J" f{x,)dt \ = lf Gr(a,b)f(b)db- j n v (a, d ( )E J J /(*,)«/* 



G r (a,b)f(b)db-^- j n v {a,d) j G r (^b)f(b)db 
r at/ r 



b)f(b)db, 



where 



Gj/(a, ft) - G r (a, b) - J n v {a, c%)G r (£, b) 
du 

1 r 1 

= lo §i w~ nu(a,d € )\og— — 

\a-b\ J \g-b\ 



5. Green function 
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i r l 

- log -= r; + nu(a, d%) log -= 

\ab-r 2 \ J \gb-r 2 



du 

Since b e U c U c T, \ab\ < r 2 for a e t/ and log \ab - r 2 \ is 
harmonic for a e U, with boundary values log \gb - r 2 \. Hence if every 
point of dU is regular, 

log \ab -r 2 \ = J n v {a, d) log \gb - r 2 \. 

du 

Thus we have 

1 C 1 

Gu(a,b) = log- 7rt/(a, J)log - — -. 

\a - b\ J |£ - b\ 

ou 

Theorem 1. If U is a bounded open set such that every point of dU is 117 

TV 

regular and if u(a - E a ( J f{x t )df), then 
o 

-Am - / and u(a) — > as a — > £ e <9£/. 

Proo/ In fact 

k(o) = £ fl I " f(x,)dtj = i Gt/(a, 

and the theorem follows from the definition of Gj/(a, □ 
Theorem 2. 

E a {S{db/U)) 1 

-G v (a,b). 

db n 

If A: = 1 , we can proceed directly. Suppose that U - {a, IS). 
Then 



E a\ -u"(x t )dt 



= E a (u(x T(aj3) )) - u(a) 
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P - a a - a 

= u(a) + u(J3) - u(a) 

ft - a p - a 

P 

= J G (a ,f3)(a,b)^u"(b)2db, 

a 

where 

(J3 - y)(x - a) 

G( a fi)(x, y) = G( a j3)(y, x) = — , a < x < y < p. 

Threfore we have 
Theorem 3. 

J f{x t )dt\ = £ G (a>p) (a,b)f(b)2db 

Theorem 4. 

E a (S(db/(a,P)) 

^ 2G (aJ3) (a,b). 

6 Hitting probability 

We have already discussed the hitting probability for spheres. Here we 
shall discuss it for more general sets, especially compact sets. 

Absolute hitting probability (k > 3). 

For simplicity we consider the case k - 3. 

Let F be a compact set and o~p = inf{? : t > and x t e F}. Put 
Pf{o) - P a (o~F < oo) = P a (x t e F for some t > 0); pf{o) is called the 
absolute hitting probability for a F with respect to a. 

Lemma (). Let Y = T(a, r) and T r = it = the first leaving time for Y. 
Then P a (T r — > as r — > 0) = 1. 

Proof. Clearly j r decreases as r decreases. If t = lim r r , we have only 

r-»0 

to show that P a (r > 0) = 0. Now P a (j > t) < P a (r r > t) < P a (x t eT) = 

(2tt0 _3/2 / exp(-(x - a) 2 Y t )dx as r -» 0. □ 
r 



6. Hitting probability 
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Theorem 1. P F (a) is expressible as a potential induced by a bounded 

measure hf i-e- Pf(p) - f tt"^ — \> where pp is concentrated on dF. 

J \b - a\ 

Further Vp is uniquely determined by F. 

Proof. Firstly we show that pf(o) is harmonic in F c nF°. Since pf(o) = 

1 in F°, we have only to show that it is harmonic in F c . Let T be ball 

such that r c F c . If rr is the first leaving time for T, Tp < o~f and 

p F (a) = P a (T r < <t f < oo) = P a {o- F {w^) < oo) = E a (P XjT (o- F < <»)) = 

E a (p F (x Tr )) = j ' 7rr(a,df)p F (g) = § aT n T (a,%)pF(i;)6(dt;), showing that 
or 

Pf{o) is harmonic for a e Y. 

Let r be a ball and a e r. Then 

p F (a) = P a (o- F < oo) > p a (o- F (w£) < oo) = I n T (a,Z)p F (%)e(dZ). 

JdT 

This show that pf(o) is super harmonic in the wide sense (i.e. its 
value at the centre of a ball in not less than the average value on the 
boundary). 

Finally we show that pf{o) is lower semi-continuous. It is enough 
to show this for a e dF. Let ao e dF, and T(ao, r) = T r , r r - Tp r . Then 
Pf{oq) - P ao (xt <= F for some t > r r ) + rj r , r\ r — > (from the lemma) 
= J p F {£)8{dt;) + n r . On the other hand 

p F (a)> J nr(a,&p F (mdd 

so that 

]imp F (a)> f lim;rr(fl,^ f ©W= f Pf{&%® = PrM - t] r . 
Now letting r — > 0, lim > pp(ao), showing that pf(a) is 

a—. >£Z0 

lower semi-continuous. Now if T is a ball containing F, crp, the first 
passage time for T, then we have seen that P a (o~r < oo) = rp~ l , p = \a\. 
Therefore P a (o~r < oo) — > as a — > oo and since P a (o~ f *~ °°) — 
Pa(o~r < oo), P a (crF < oo) — > as a — > oo. Since pf(a) is super 
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harmonic in R 3 , from the Reisz representation theorem there exists a 

c jj.p{db) 

unique bounded measure pp with pf(o) = — + H(a) where H(a) 

J \b- a\ 

120 is harmonic in R 3 . But pf(o) — > 0|a| — > oo and also J ^-a] ~~ * ^ as 
\a\ — > oo since pip is a bounded measure. It follows that H(a) — > as 

|a| — > oo i.e. //(a) = 0. Therefore pf(o) - f tt^~~~t- Since pp is 

J |o - a\ 

concentrated in the set where pp is not harmonic, fip is concentrated in 
dF. This proves the theorem completely. □ 

Theorem 2. 7f u{a) is any potential induced by a measure v which is 
concentrated in F and if u(a) < 1, then 

u(a) < Pf(o) andv{F) < pp{F){= pf(9F)). 
r v(db) 

Proof. We have u(a) - . Since F is compact, for fixed a we 

Jt \a-b\ 

can find n such that \a - b\ < n. It follows that v(F) < oo and therefore 
u(a) is harmonic in F c . Let G„ \ F c be a sequence of bounded open sets 
such that G n c G n+ i. Let t„ = tg„ = the first leaving time from G n . If 
we put / = ujG„ then u is the classical solution with boundary values 
/. Therefore for every a e G„ 

u(a) = E a (f(x T J) 

- E a (u(x T J) - E a (u(x Tn ) : cr F = oo) + E a (u(x T J : cr F < oo). 



Now t„ t o~f. If o~f = °°,t„ t 00 and x Tn t 00 with probability 1; 
and by the formula for u, u(x T J — > 0. Since u(a) < 1 we have therefore 

u(a) < E a (cr F < oo) - pp(a). 

121 If a e F°, p F (a) = 1 and u(a) < 1 = p F (a). 

Let now a e dF and T = T(a, r) and r r the first leaving time for T. 
Then 



p F {a) > P a {x t e F for some f > r r ) 



6. Hitting probability 
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= P a (x t (w+ r ) e F for some t > 0) 

= E a [P Xrr {x t € F for some t > 0)] 

= E a P Xrr (x t e F for some t > 0) : x Tr e F c 

+ E a P Xrr {x t e F for some t > 0) : x Tr e F) 
> E a [x Tr e F c : w(x Tr )] + E a [x Tr e F : 1] > F a [wU Tr )] 

since F a (x? e ^ f° r some f > 0) = 1 for a e F. Letting r^Owe get 

Pf(o) > UmE a (u(x Tr )) > E a Qimu(x Tr )) > u(a) 

r^0 r->0 

since u(a) is lower semi-continuous. It remains to prove that v(F) < 
Mf(F). 

Let E be a compact set with E D E° D F and consider pe{o). Then 

Pe(o) - f ^ £ ^f? and pe(o) - 1 for a e £° D F. Since 
J \a - b\ 

C nwidb) > f v(db) 
J \a-b\ 'J \b-a\ 

JJ v^b-f E{da) - J J v^r m 

f p F (db)> f v(db). 
Jf Jf 



we have 



i.e., 



An alternative proof of the last fact is the following. Since pf(o) > 
u(a) 



r . pFidb) r Mdb) 

J F \b-a\ J F \b - a\ 



Letting fl->oowe get the result. 
From the above theorem we have 



Theorem 3. C(F) - pp(dF) is the maximal total charge for those 
charge distributions which induce potentials < 1. 
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Theorem 4 (Kakutani). C(F) > if and only if p F {a) > i.e. 

P a {x t e F for some t > 0) > 0. 
C(F) is called the capacity of F. 
Theorem 5. 

< Pf(o) < — , — ~~~~ — - andC(F) - lim \a\pp(a). 



max \a - b\ min \b - a\ \a\->oo 

beF b€F 

We shall now prove the subadditivity of pp (a) and C(F) following 
Hunt. This means that p F ifl) and C(F) are both strong capacities in the 
sense of Choquet. 

Theorem 6. p F {ci) and C(F) are subadditive in the following sense. 
<p(F 1 n---nF n )< i Z<p(F i )- i Z j <p(F i UFj)+ 2 <p(FiUFjVF k )--- 

i< j<k 

where (f(F) denotes either of pf(a) and C(F). 

Proof Put F* = {w : cr F (w) < oo}. Then (Fi U • • • U F n )* = F\ U • • • U 
F*, (F\ n • • • n F n )* c F\ n • • • n F* and p F (a) = P a (F*). Using the dual 
inclusion - exclusion formula of Hunt, we have 

p Fl n-nF n (a) = P a l{Fi n • • • n F n )*] < P a [(F{ n • • • n F*)] 

^^-Z^^i^ 

- ^ F F ,(a) - ^ PF,uFj(a) + ^ PF,uFjUF k (a) - - - 



Multiplying by |a| both sides and letting \a\ — > oo we get the said 
inequality for C(F). 

Hitting probability for open sets. 

Let U be a bounded open set and define cry and Pu(a) as in the 
case of compact sets F. Then p\j{a) is harmonic outside <9£/ and super 

harmonic in the whole space. Therefore pu(a) - f j n (dU) c , 

Su l a -^l 
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and nu{dU) - lim \a\pu(a). Let F n f £/ be compact subsets of U. 

\a\— >oo 

Then C(F„) - lim |a|^f„(a) and the convergence is uniform in n since 

|fl|— >oo 

F n are contained in a bounded set. Also since 

P v (a) = P a (<rj/ < oo) = lim P a (cr Fn < oo) = limp Fn (a) 

n-»oo 

we have 

A*t/(<9t/) - lim C{F n ). 

n— >oo 

Therefore pjjdU) is the supremum of capacities of compact sets 124 
contained in U; it is the capacity C(U) of £/ by definition. Again 

Pu(a) ^ ■ ,, [• 

mm o - a 

foe<9C7 

Remark. The capacity of any set is defined as follows. We have already 
defined the notion of capacity for compact sets. The capacity of any 
open set is by definition the supermum of the capacities of compact sets 
contained in it. The outer capacity of a set is the infimum of the capaci- 
ties of open sets containing it, while the inner capacity is the supremum 
of the capacities of compact sets contained in it. If both are equal the 
set is called capacitable and the outer (or inner) capacity is called the 
capacity of the set. Choquet has proved that every Borel (even analytic) 
set is capacitable. 



Relative hitting probability (k > 1). 

Let F be a compact set contained in a bounded open set U and put 
<Tf/u = inf{* : fu > t an d x t e F) where t\j is the first leaving 
time from U. Let Pf/u(o) - Pa{o~Fiu < °°) = PA for some t > 0x t 
reaches F before it leaves U. PF/u( a ) is called the (relative) hitting 
probability for F with respect to a and relative to U. Using the same 
idea as before we can prove 

Theorem V. pF/uia) is expressible as a potential induced by a bounded 
measure pp/u with the Green function Gu(a,b), i.e. 



PF/u(a) = Gu{a,b)p F/u {db),a e U, 
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where pp/u i s concentrated on F. Further pp/u i s uniquely determined 
byF. 

We can define the relative capacity Cu(F) of F as pp/u(6F) and 
carry out similar discussions. 

Remark on absolute hitting probability (k < 2). 

In case k - 1, pp{a) = or = 1 according as F + <p or = (p. 

In case k - 2, we contend that pf(o) = 1 or according as Cu(F) > 
or = 0, where U is a bounded open set containing F. To prove this 
let V be another bounded open set such that F c V c V c U. Let 

(Tl(w) = Tu(w) + Cry(w+), Cr 2 (w) = 0"l(w) + tT^wJj), 0" 3 (w) - Cr 2 (w) + 

0"i (wj 2 ), . . . , £T„(w) = o-„_i(w)+o-i(w+_ 1 ), etc. Then evidently x an e dV 
and cr„ t °°; for let, a' n {w) = cr„-iO) + Tt/(w+ n Then cr n -\ < cr' n < 
cr n , and x an e 5V, x^ e <9£/ so that if cr n 'I cr, x^ e dV Ci Oil = (f> which 
is a contradiction. Hence o~„ t 00 with /^-probability 1. If Cu{F) = 0, 
then p F /u(xa n ) = 0. Now 

P a (x, e F,tr n < t < <r n+ i = Pa^H*^) < tu(w* h )) 

= E a (P Xgn (o- F (w) < Tu( W ))) = Eaipp/uiXcrJ) = 0. 

Hence Pp{a) - P a {x t e F for some f > 0) < 11 P a (x t £ F,cr n < t < 
cr n+l ) = 0. Now 

1 - p F (a) < P a (xt t F,o < t < o- n 

< P a (o- F (K) > ru« r )(< r < n) 

The set (o>(w£ r )j > Tf/(wJ r ), 1 < r < n - 1) is Sa- n+ -meansurable. 

For 

(0>(<) < Tj/(<)) - (O-Flw^i)^)] > ^[(w^)^-^]) 

Hence (o> (wj r ) < Ty(wJ r )) € B<r r+l c B^, for r+ 1 = n. [Note that 
if o"i, o"2 are two Markov times and o~i < o~2 then B c - 1 c Bo-J. Hance 
by strong Markov property 
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= E a [p X(rn {cr F > t f ) : o- F {w%) > Tu(w+ r ), 1 < r < n - 1] 

If Cu(F) > 0, since p F ju(a) is continuous on dV and always > it 
has a minimum 6 > 0. Then 

Pa{0-F{K) > TlK*0 1 < ^ < ") < (1 - e)^ a (0-F« r ) 

> Tu(w+ r ), \<r<n-\)<...<(\-eT ^C. 
This proves our contertion. 



7 Regular points (£ > 3) 

In order to decide whether the garalied solution (the stochastic solution) 
u(a) = u(a : /, v) satisfies the boundary conditions 

lim «(«) = /(£), {edU 

aell, 

we introduce the notion of regularity of boundary points. 127 
Let U be an open set and £ e dll. Let 

t\j - mf{t : t >0 and x, £ U), 

and consider the event t* v = 0. This clearly belongs to B + and Blumen- 
thal 0-1 law gives P^(t* v - 0) = 1 or 0. If it is 1, £ is called a regular 
point for U; if it is zero it is called irregular for U. Regularity is a local 
property. In fact, if £ is regular for U, £ is regular for T n [/ for any 
open neighbourhood T of £ and vice versa. We state here two important 
criteria for regularity. 

Theorem 1. Let £ e dU. 

(a) t; is regular for U if and only if lim P a (x(T* lT ) £ dU n T) - 1. 

(b) g is irregular for U if and only if 'lim lim P a (jc(T^) £ n T) = 0. 
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Theorem 2 (Winer's test). IfgeU and 

F n = (b: 2- ( ' !+1)( *- 2) < \b -£| < 2-' l{k - 2 \be U c ) 
is regular or irregular according as Yj 2~ n(k ~ 2 ^C(F n ) = oo or < oo. 

n 

We can prove the above two theorems using the same idea we used 
for the proof of Poincare's test. 

128 The following theorem, an immediate corollary of Theorem ffl gives 
the boundary values of the stochastic solution. 

Theorem 3.IfU is a bounded open set, if £, is regular for U and iff is 
bounded Borel on dU and continuous at then 

lim u(a :f,U) = f(g). 

On the other hand if is irregular for U, then there exists a contin- 
uous funtion f on dU such that the above equality is not true. 

The following thorem, which we shall state whithout proof, shows 
that the set of irregular points is very small compared with the rest. 

Theorem 4. Let U be a bounded open set. Then the set of irregular 
points has capacity zero. 

Using Theorem |5] and |3] we prove the following 

Theorem S.IfU is a bounded open set and iff is continuous on dU the 
stochastic solution u(a) - u(a : /, U) is the unique bounded harmonic 
function defined in U such that 

lim u{a)=f(g),€edU 

aeU,a~>£; 

except for a set of capacity zero. 

Proof. It folllows at once from Theorem|2]and|3]that the stochastic solu- 

129 tion is a bounded harmonic function with boundary values / at regualar 
points. Conversely let v be any bounded harmonic funtion with the 
boundary values / upto capacity zero. Let ,/V be the set of all points £ 
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such that v{d) /(£). Then C{N) - by assumption. Therefore there 
exists a decreasing sequence of open sets G m D ./V such that G m +\ c G m 
and C(G m ) — » 0. Since N is bounded we can assume that G m are also 
bounded and since N c dU, we can assume that f] G m c dU. Let 

m 

a e U. Then p(a, G m ) - inf p(a, b) > some positive constant for large 

beG m 

m. Therefore 



P a (x Tu €N)<P a 



< P a [o- Cm <oo]< 



C(G m ) 



(p(a, G m )> 



k-2 



so that P a (x Tu € N) = 1. Let now £/„ be open sets, [/„ t U such that 
C/„ c U and every boundary point of U n is a Poincare point for U„. 
Then v(a) = E a (b(x Tu )), a € C/„ so that 



v(a) = lim £" a (v(x T )) - £ a (lim v(x r )) 

ll—>oo " I } — > CO " 

= £ a ( lim v(x r ) : lim x r = x Tu i N) 

it — >oo " n—>oo " 

= E a (f(x Tu ) : Xr v <£N) = E a (f{x ru )) = u{a : /, U) 



8 Plane measure of a two dimensional Brownian 
motion curve 

We have seen in Theorem [5] of §@]that the two-dimensional Brownian 
motion is dense in the plane. We now prove the following interesting 
theorem due to Paul Levy. 

Theorem 1 (P. Levy). The two dimensional Lebesgue measure of a two- 
dimensional Brownian motion curve is zero with probability 1 i.e. if 
C(w) = [x s : < s < oo), and |C| = the Lebesgue measure ofC(w) then 
P a (\C\ = 0) = 1. 

We first prove the following lemma. 

Lemma (). Let S be a Hausdorjf space with the second countability 
axiom and W a class of continuous functions fo [0, t] into S. Let B be the 
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Borel algebra generated by the class of all sets of the form {w : w e W 
and w(s) e E] where < s < t and E € B(5), B(5) being the class of 
Borel subsets ofS (i.e. the Boral algebra generated by open sets ofS ). 
Let C(w) = {w(s) : < s < t). Then the function defined by 

f(a,w) -lifae C(w) 
= Qifa<t C(w) 

is B(5) X ^-measurable in the pair (a, w). 

Proof. It is clearly enough to prove that 

[(a,w) :a<t C(w)|eB(S)xB. 

For any open set U c S we have 

(w : C(w) c U c ) - - P {w : w(r) e U c \ 

r<t 
r, rational 

so that 

(w : C(w) c U c ) e B. 
Let now U n be a countable base for S . Then it is not difficult to see 

that 

CO 

{(a,w) : a C(w)} - |J x {w : C(w)£^}] 

n=l 

using the fact that C(w) being the continuous image of [o, t] is closed. 
Q.E.D. □ 

Proof of Theorem. To prove the theorem it is enough toi consider two 
dimensional Brownian motion curves starting at zero i.e. a two-dimen- 
sional Wiener process. Let x t (w) be a two-dimensional Wiener process 
on Q(B,F). It is enough to show that E(\c t \) = 0, where c t = [x s : < 
s < t) and |q| = the two dimensional Lebesgue measure of c t . From the 
lemma the function x(a, c t ) defined as 



X(a, c t ) = 1 if a e c, 
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= if a g c t 

is measurable in the pair {a, w). Since \c t \ - J x( a > c t )da, \c t \ is measur- 

R 2 

able in w. Consider the following four processes: 
1. x s (w),0 < s <t 
2- y s (w) = x s+t (w) - x t (w), < s < t 

3. z s (w) = x t - s (w) - x t (w), < s < t 

X2s(w) 

4. u s (w) = -^-r- ,0<s<t. 

V2 

All the four processes are continuous processes i.e. processes whose 
sample functions are continuous. Let 

= {x s : < s < t \ 

with similar meanings for c",cj and c\. Now the form of the Gaussian 
distribution shows that all the above four processes have the same joint 
distributions at any finite system of points. It follows that the distri- 
butions induced on [/? 2 ] [o ' f] by the above processes are the same. Also 
X{a, cf ) = f(a, x) where / is the function in the lemma and x denotes 
the path. Thus we have 

E(x{a,c x t )) = E(x(a,<? t )) = E(x{a,c])) = E(x(a,c?)). 

Hence 

E{\c x t \)= f E(x(a,c x ))da= [ E(x{a, c u t ))da = E(\c?\). 

JR 2 JR 2 

We have 

c\ t = {x s : < s < It = c x t U [c] + x t ] 
= [c x - x t ] U = c z t U cj, 
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where = denotes congruency under translation. Therefore |c£J+|cJriCj| = 
\c z t \ + \<? t \, and 

£(141) + E{W t n c z t \) = E{\c]\) + £ (|cj|) = 2E(\c x \). 

Also 

E(\c x \) = E(\ V2cri) = E(2\c?\) = 2E{\c u t \) = 2E(\c x \) 
Therefore 

E(\c? t n 0^1) = i.e. J E(x(a, c x )E X (a, c y t ))da = 0. 

R 2 

Since the process y and z are easily seen to be independent 

E(x(a,c x )E X (a,c> t )) = E(x(a, <*))E<x(a, c?)) - [E(x(a, c x ))] 2 . 

Therefore J[E(x(a, c x ))] 2 da - giving E(x(a, c x )) = for almost 
all a. Hence J E(x(a,c x ))da = i.e E(\c x \) = 0. This proves the theo- 
rem. 



Section 4 

Additive Processes 



1 Definitions 

Let x. = (x t ,0 < t < a) be a stochastic process on a probability space 
(Q., P). If I = (t\,t2] the increment of x in / is by definition the random 
variable x(I) - x tl - x h . 

Definition (). A process, x. — (x t ) with xq = is called an additive 
(or differential) process, if for every finite disjount system I\,...,I n of 
intervals, x(I\), . . ., x(I n ) are independent. 

We shall only consider additive processes x for which E(xj) < oo 
for all t. In this case E(x t ) = m(f) exists and is called the first moment of 
x t .E((x t - m{t)) 2 ) is called the varience of x t and is denoted by V(x t ) or 
v(t). If y t - x t - m(t),y. = (y t ) is also additive. 

Definition (). A process x - (x t ) is said to be continuous in probability 
at to or said to have fixed discontinuity at to, if for every €> 0, 

lim P[\x t - x t0 \ > e] = 0. 
t->t 

If it is continuous in probability at every point t it is said to be con- 
tinuous in probability. 

The following theorem is due to Doob. 
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Theorem 1. If an additive process (x t ) has no fixed discontinuity then 135 
there exists a process (y t ) such that 

(1) P(x t = y t ) = \forallt; 

(2) almost all sample functions of(y t ) are d\. 

If further (y t ), (y' t ) are two such processes, then 

F '(for every t,y t -y' t )-\. 

y. = (y t ) is called the standard modification of x t . The proof can 
be seen in Doob 's Stochastic processes. 

Definition (). An additive process (x t ) with no point of fixed discontinu- 
ity and whose sample paths are d\ with probability 1 is called a Levy 
process. 

It can be seen easily that Wiener processes and Poison processes are 
particular cases of Levy processes. 

Definition (). A process (x t ) is called temporally homogeneous if the 
probability distribution of x s - x t (s > t) depends only on s - t. 

The above theorem of Doob shows that it is enough to study Levy 
processes in order of study additive processes with no point of fixed 
discontinuity. 

2 Gaussian additive processes and poisson additive 
processes 

The following two theorems give two elementary types of Levy pro- 
cesses. 

Definition (). An additive process (x t ) which almost all sample paths 
continuous is called a Gaussian additive process. If for almost all w, the 
sample functions are step fucntions increasing with jump 1 the process 
is called a Poisson additive process. 
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Ill 



We prove the following two theorem which justify the above nomen- 
clature. 

Theorem 1. Let (x t ) be a Levy process. If x t (w) is continuous in t for 
almost all w, then x(I) is Gassian variable. 

The condition that x t is continuous of almost all w is sometimes 
referred to as "(x t ) has no moving discontinuity" in contrast with "(x t ) 
has no fixed discontinuity". 

Proof. Let / = (to, t\]. Since almost all sample functions are continuous, 
for any e > 0, there exists a 8(e) > such that 

P(for all t, s e I, \t - s\ < 8 => \x t - x s \ < e) > 1 - e. 

Noting this, let for each n, 

to = t no <t m < ... < t Hpn = t\ 

be a subdivision of (toJi], with < t n i - t n i-\ < 8(e n ), where e n J, 0. 

Pn 

Let x n k - x(t n k) - x(t„k-\). Then x - x(I) - 2 x„k. Define x' , - x nk if 

k=i nk 

Pn 

\x„k\ <e„ and zero otherwise. Put x n = Y x' ,. Then from the above it 

k=i nk 

follows that 

P(x = x n ) > 1- e n ; 

i.e., that x„ — > x in probability. Since x„u are independent so are x' nk . 137 
Therefore 

Pn 

E(e iax ) = lim E(e iax ") - lim \1 E(e iax '^). 

n—>co n— *oo 1 1 
k=l 



Let m nk - E(x'), V nk - V(x'), m n = £ m nk and V„ £ V nk . Then 
nk nk k=i k=i 

\m nk \ <€„ and V nk < 4 e 2 n . Now 

Pn 

E(e iax ) - lim e iam " fl £(e'' Qf( ^" m "* ) ) 

k=i 



112 



4. Additive Processes 



= lim e iam " PI 

n— *oo 1 1 

k=l 



or 



so that 



2 2 2 

< lim ]^e~^V„* = lim e~^V n < e'^ lim V„. 



Since E(e' ax ) is continuous in a and is 1 at a = 0, for sufficient 
small a, E(e mx ) + 0. Hence lim V„ < oo, i.e. V n is bounded. By taking 

n— >oo 

a subsequence if necessary we can assume that V n — > V. 

Pn 

We can very easily prove taht if z n - Z Zm suc h that 

(1) sup \tni\ — > as « — > oo; 

i<i'<p„ 



(2) 11 km I i s bounded uniformly in «; and 

(=i 



(3) z„ -> z, then 



lim Ff[l -z m ] = e" 

n—oo 1 1 
(=1 



9 P " 

Now in our case max \V n t\ < 4 e„-> 0, £ ^[1 +0(e„)] -> V and 
V„* > so that 



lim 



* n 

n 

k=\ 



a 



1-— V nk (\+0(€ n )) 



2 

= e 2 \ 



Therefore = lim e^ e -« 2 /v This i mp ii es mat (p( a ) = 

lim e iam " exists. Now if < (3 < n/2, 



p p 
J~ (p(a)da - lim J 



JPm n _ i 

e ,am » da = lim - 
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if m n — > ±00, and then <p(a) - for almost all a < n/2, i.e. 
E{e iax ) = for almost all a < n/2 and this is a contradiction. 
Therefore m n — > m and 



Theorem 2. Le? fee a Levy process. If almost all sample functions 
are step functions with jump 1, then x(I) is a Poisson variable. 

Proof. From the continuity in probability of x t , 

sup P(\x t - x s \ > 1) — > as n — > 00. 

|f-^|<n _1 ,i <f,J<ri 

For each «, let t - t no < t n \ < ■■■ < t nPn - t u t ni - t ni -\ < -, be a 

n 

subdivision of [t , t\] and let x nk = x tnk - x tnk - X ,x' nk = x nk if x nk = or 
1 and x' nk = 1 if x nk > 2. Put x n - 2Z x ' nk - Then since P(x n — > x) - 1, 

Pn 



E(e~ ax ) = lim E(e~ ax ") = lim \1 E(e~ ax '^) 

n — *oo n— >co 1 1 

/t=i 

fit 

= lim P[ [(1 - p nk ) + p nk e- a ] = lim ]~f [1 - P rt (l - O] 
/t=l yt=l 

< lim ff = lim = 

£=1 

/>„ 

where - P(x„^ > 1) = P(x' = 1) and P n = £ p mfc- Therefore P H 

is bounded. We can assume that — > i 3 . Again since max P nk — > 0, 

1 
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3 Levy's canonical form 

Before considering the decomposition of a Levy process we prove some 
lemmas. 

Lemma 1. Let (x t ) be a Levy process and (y t ) a Pisson additive process. 
Suppose further that (z t ) = ((x t ,y t )) is a vector-valued additive process. 
Then, if 

P(for every t, x t = x t - ory t = y t J) = 1, 
the processes (x t ) and (y t ) are independent. 
Proof. It is enough to prove that 

P(x(I) e E,y(D e F) = P{x{I) e E)P(y{I) e F). 

For once this is proved we have, by the additivity of (z t ), for any 
finite disjoint system I\, ...,I n of intervals, 

P(x(Ii) e Ei,y(Ii) e F,), i = 1,2, ...,«) = P{x{h) € E u y{I t ) e F,-) 

i-i 

n 

= Y\P{x{I i )E i )P(y{I i )F i ) 

i-i 

- P[x(Id e E h i = 1, 2, . . . , n\PWi) e F,j = l,2,...,n], 

and the proof can be completed easily. □ 

Since y(7) is a Poisson variable it is enough to prove that E(e iax ^ : 
y(I) - K)E(e iax ^)p(y(I) = K). 

Let / = (to,t\]. For each n let to = t n o < t m < . . . « t„ n - t\, 

t n i - t n -\ - ~{h - to) be the subdivision of / into n equal intervals. Put 
n 

*ni = x(t ni ) - x(t n i-i),y ni = y(t ni J - y(t ni -i)x' ni = x ni \fy ni = 0,x' ni = 

n n 

if y n i > 1, and x„ = £ x' n . = 2 x ni . We have x = x(I) = 2 x ni 

(=1 y m =0 i=l 

and |x(w) - x„(w)| < y m - J] x n ,(w). Since y t (w) is a Poisson variable 

(W)>1 

increasing with jump 1 the number of terms in the right hand side of the 
last inequality is at most y(w) - P (say). Suppose that t\(w), t p (w) 
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are the points in /, at which y t {w) has jumps. Then \x(w) - x n (w)\ < 
p 

Y \x(s'.) - x(s n ;)\ where (s n ;, s'.] is the interval of the nth subdivision 

n j 3 3 n j 

which contains tj(w). Now \x{s' n] ) - x(s n j)\ < \x(s' n j)\ - x( 
tauj)\ + \x(Tj) - x(s n j)\. Since at T\ , . . . , t p , y t {w) has jumps, x t (w) has no 
jumps at these points. Therefore \x(t j)-x(s n j)\ and \x(x(s' n j)\-x(Tj)\ — > 141 
as n — > oo. Thus P(x n — > x) - 1. Now 

E{e ia *» :y = k) = Y, Z 

r<& 0<ii</i 2 <-<i r <n 
/>!+•••+?,.=£ 

Pl,-,Pr>i 

e ia : )W = P<r, o" = 1, 2, • • • r 

y n A=0MA a 



Put 



ynA=0MA<r 



= E 



r(A)(p) 



Using the hypothesis that (x t ,y t ) is additive one shows without dif- 
ficulty that 

E Kxm = I ] E(e iax »*) : y nA = 0) ] [ P(y nAtr = Pa ), 

A+Ao- \<cr<r 

so that 

ia 2 x n A 

E r (Mp) = E(e A * A <r : y nA = 0,A± Aa-)P(y nAtr = po-,1 < cr <r) 

Also P(y = 0) = POM - for all A)P(y nA = 0,A * A cr )P{Y nAtr = 
0, 1 < cr < r). Therefore (using the additivity of (x t ,y t ) again) 

ia £ x n A 

Er W ( P) P(y = 0) = E(e : y n A = 0,Ai= A a )P(y nA „ = 0, 1 < cr < r) 

x xP(y nA<r = P<T ,l<o-< r)P(y nA = 0,A* A*) 

ia 2 x„/l 

= E(e :y n A = for all A) 

p (ynA a = p<rA <o-< r,y nA =0,A* A IT ) 

ia X x nA 

= E(e x * x - : y = 



116 



4. Additive Processes 



p (ynA r = Pa; 1 < o- < = 0, ^ * Ao-). 

Therefore 

P(y - 0)£(<>*« : y = *) = £ £ ^(P)^ = °) 

r<k Q<A\<...<A r <n 
p 1+ ...+p r= k 

Pl,-,Pr>l 

2 £(« ^ :y = 0) 

r<i: 0</li<...</i r <n 
P 1+ ...+P r =fc 
Pl,...,P r >l 



Now 



PtynA^ = Pa-,ynA = 0, A ± Xa) 



ia 2 r'nAcr 



\E \e **r " ; y = Oj - E (e iax : y = 0) | < E \\e ' - 1| 

r 

< J] £ - 1 1) < K sup E (\e iax ' - e iax ° |) -» 0, 

' |f-s|<j(fi-f ) 

fo<M<fi 



cr=l 



as « — > oo, since x f has no point of fixed discontinuity. We thus have, 
since P(y = k) = £ Z - /Wi^wu*^), 

r<£ (i) 
(P) 

\p(y = 0)E (e iax " :y = k)-p(y = k)E{e iax ;y = 0) 

<J]J] E W ^ :y = o\-E (e iax :y = 0) 

r<k (A) ' ' 

(P) 

(('a 2 x n A \ 
e «v : y = \-E(e iax :y = 0)\ 
I 

Y_i P^nA^ = Pa-ynA =0,A± X a ) 

r<k( A ) 

(P) 

(ia 2 x n A \ 
e «v :3 ;^o \-E(e mx : y = 0)| -» 0. 
/ 
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Therefore p(y = 0)E(e iax : y = k) = E(e iax : y = 0)P(y = k). 143 
Summing the above for k - 0, 1, 2, ... we get P(y = 0)E(e' ax ) - E(e iax : 
y - 0). Hence finally we have 

P(y = 0)E(e iax :y = k) = E(e iax : y = 0) 
P{y = k) = E(e iax )P(y = 0)P(y = k), 

i.e., 

: y = k) = P(y = k)E(e iax ). 
We have proved the lemma. 

Remark. We can prove that if x. - (x t ), 'y. - (y t ) are independent Levy 
processes, then 

P(for every t, x t = x t - or y t = y t -) = 1. 

Lemma 2 (Ottaviani). If >i(.), . . . , r„(.) are independent stochastic pro- 
cesses almost all of whose- sample functions are of type d\, then for any 
€>0, 

max \\n(-) + ••• + r m (-)|| > 2 e 

1 <m<n 

P Oh + • • • + r„\\ >€] 



1 - max P [||r ra+1 + • • • + r„|| >€] 

l<m<n-l 



where \\r\\ = \\r(-)\\ = sup \r(s)\. 

0<s<t 

Proof. Let 



A m = max ||n + • • • + r^\\ < 2 e, ||n + • • • + r m \\2 e 

\a<n<m— 1 

B m = (\\r m+1 + ■ ■ ■ + r n \\ <e). 

Then since A m are disjoint, A m D B m are also disjoint. Further 
U A m B m c C = (||n + • • • + r n \\ >e), so that 144 

m=l 



118 



4. Additive Processes 



P(c) > YP(A m n B m ) = V P(A m )P(B m ) > P(UA m )mmP(B m ) 

z — ' z — ' m=l 

n 

If we now note that mmP{B m ) - 1 - maxi< m <„ P(B^ n ) we get the 
result. □ 

Lemma 3. Let (x t ) be a Levy process, such that E(x(t)) = 0, E(x(t) 2 ) < 
oo. Then for any €> 0, 



sup \x{s)\ >e 

0<S<t 



< -U(40 2 ). 
e 2 



Proo/ This lemma is the continuous version of Kolmogoroff 's inequal- 
ity which is as follows. 

Kolomogoroff's inequality. If x n are independent random vari- 
ables with E(xi) - 0, E(xj) < oo, i = 1,2, ... ,n, and if S m - x\+- ■ -+x m , 
then 

p(max \S m \ > e) < \e(S 2 k ). 

\\<m<n I e 

The lemma follows easily from this inequality. 
Let now (x t ,o < t < a) be a Levy process, S - {(s,u) : o < s < 
a, -oo < u < oo}. Let B(5) be the set of Borel subsets of S and 

E + (S) = {E:E e 1(5) and p(£, s - axis) > 0). 

For every w we define 

J(w) = ((t, u) e 5 : x f (w) - x f _(w) = u + 0, o < t < a). 

For £" € 1(5 ) put /?(£") = number of points in J(w) n For fixed w, 
therefore p is a mesure on 1(5). We can prove that p(E) is measurable 
in w, for fixed E e l + (5). Let cr(M) = E(p(M)) for M e l + (5). Then 
we have the □ 

Theorem (). 

x t - Xoo{t) + lim I [up(ds du) - uo~(ds du)] 

n— >oo J 

[o,t]x(u:\>\u\>j-) 
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+ ^ up(ds du) 

[o,flx(|«|>l) 
where Xoo(f) is continous. 

Proof. The proof is in several stages. Let E t - E n [(s, u) : o < s < t] 
forE e B + (S). 

1 . We shall first prove that yf = p(E t ) is an additive Poisson process. 

Using the fact that x t is of type d\ it is not difficult to see that 
yf < oo, and that it increases with jump 1. 

Let B ts be the least Boral algebra with respect to which x u -x v , s < 
u, v < t, are measurable. We shall prove tha t Yf - yf is Im- 
measurable. It suffices to prove this when E = G is open. Let 
G m t G,G m c G m+ \ be a sequnce of open sets such that G m 
is compact. Let yf - yf = N, yf" 1 - yf m = N m . For every n 
let t n k = s + k^p-, k = 1, 2, . . . ,n and N™ =number of k such 
that (%,x* -Xfr)e G m . Then N m -i < UmA^ < N m+ \,N™ is 

^ k k-i n—>co 

measurable in w with respect to B fiS , and yf -yf == lim lim N™. 

Now suppose that /; = (j,-, t\\i - 1, 2, . . . ,n are disjoint. Then B f;i; , 
1 < / < n are independent and vj^ is B ((Si -measurable. Therefore 
yf is an additive process. 

Finally yf has no fixed discontinuity. For, a fixed discontinuity of 
yf is also a fixed discontinuity of x t . 

Thus we have proved that p(E t ) is an additive Poisson process. 

2. Let r(E t ) = £ u = f up(ds du). 

(s,u)eE,nJ ' 

We prove that r(E t ) is additive. For every w e Q., p is a mea- 
sure on B(E t - E s ). Any simple function on E t - E s is of the 

n 

form Yj a iXFi where F,- e B(E t - E s ), i = 1, 2, . . . , n, are disjoint. 
(=1 

Also J^_ £j (E aiXF,)p(ds du) = £ aip(Fi), so that J^_ £j (Z 
p(dsdu) is B Ls -measurable. It follows that 

K^t) _ r (£«) - I up(ds du) 

JE,-E S 
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is B^-measurable. Let xf - x t - r{E t ). Using the fact that 
r(E t )-r(E s ) is B, v -measurable, it is seen without difficulty that xf 
is a Levy process. Since z E = (xf,yf) is additive, and P[xf - xf 
or yf - yf for every t) - 1 it follows that x E . and y E are indepen- 
dent. 

3. Now we prove that E\,...,E n e B + (S) are disjoint then 
x ElU '" uE ", y E . 1 , . . . ,y E " are independent. For simplicity we prove 
this for n = 2. Put x\ - xf 1 . Then (x\) El - xf [UE2 and the process 
y E . 2 defined with respect to x' t is the same as yf 2 with respect to 
x t . Hence, since (x'.) E2 and y El are independent from 2, x ElUE2 
and y E . 2 are independent. Further x ElUE2 ,y E2 ) is measurable with 
respect to B(x E 1 , the least Borel algebra with respect to which xf ' 
is measurable for all t, and B(x El ), B(y Ei are independent. There- 
fore (x ElUE2 ,y E2 ) and y El are independent. It follows that x ElUE2 , 
y El and y El are independent. 

4. xf and r{E t ) are independent. 

Since r(£" ; ) - J E u p(ds du), it is enough to prove that if F is a 

simple function on E t , J E F p(ds du) and xf are independent; this 
follows from 3. 

5. Ifo-(Af) = E(p(M))thenE(e iar ^) = exp(f E (e iau - l)cr(ds du)). 

It is again enough to prove this for simple functions on E t . Note 
that if y is a Poisson variable then E(e' ay ) = e^ e ""~^ where A = 
E(y), so that for any yS we have E(e ia/3y ) = e v -**~ 1 \ 

Let f = Yj s iXFi be a simple function on E t with F„ 1 < i < n 
disjoint. Since are independent random variables we have 

£|exp|J fp{dsdu)^ = E e ^ = Y\ n j=l E{e ms ' p{F ' ) ) 

= \\ exp(^(F 7 )(V^-l)) 



- n!< 7 < n exp | 5 - l)tr(«fa du)j 
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exp 



exp 



( n \ 

/ia 2 sjXf m 
(e 7-1 )cr(ds du) 

E, 

J (e iaf - \)o-(ds du) 



6. Let U = ((s, u)eS :\u\> 1), U" = ((s, u) e S : ± < \u\ < 1). 
Then x, = xf + r(Uf), and since (Xf and r(E t ) are independent 



\E(e iax ')\ 



E{e^)\\E(e iar ^)\<\E(e ia ' iu ^) 



| cr(dsdu) 



f (e iau - 1) 
exp I (cos au - \)cr(dsdu) 

4 Ju'J 



\ 



< exp 



u o~(ds du) , 



2 2 

a u 



because cos aw - 1 < — for \a\ < 1. It follows that u 

4 u > 

cr(ds du) < oo for every n. Therefore lim f u 2 cr(ds du) < oo. 

7. Let r n (t) - r(U") - E(r(U'})), then r n (t) converges uniformly in 
[o, a). The limit we denote by r^t). 

Now r(U™ +k+l ) - r{U' t n+k ) = r(U™ +k+1 - U'; i+k ). It follows that 
r m +k(-) - r m+ k~\(-),k = 1,2, ... ,n - m are independent. Using 
Lemmas El and |5] 



P max \\r m+k - r m \\ > 2 e < — 

\\<k<n-m ) 1 - max P(\\r n - r m+ k\\ >e) 



\<k<n—m-\ 



h Su*-ir u2 °~( ds du) 



Oasm,«-> oo. 
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since 

E(\r n (t) - r m (t)\ 2 ) = E{\r{U'l - U?) - E(r{U n t - U?)\ 2 ) 



f u[ 



= £ 1 1 I u[p(ds du) - cr{ds du)] 2 



149 and 



^ u(p(ds du) - cr(ds du)) 2 ^ - ^ u 2 cr{ds du)j 

which can be proved by first considering simple functions etc., 
and noting the fact that if y is a Poisson variable, then 

E[(y - E(y)) 2 ] = E(y). 

8. Let x n (t) = xf + E(r(U';)) - r(U t ) = x t - r n (t) - r(U t ). Since 
r u (t) converges uniformly, in every compact subinterval of [o, a), 
with probabilty 1, x n (t) converges uniformly in [o, a), say to x^t). 

Since x n (f) has no jumps exceeding - in absolute value x^t) is 

n 

continuous. We have 
x t = r(U t ) + lim r n (t) + lim x n (t) = 

n—>co n—>co 

= I up(ds du) + lim [up(ds du) - ucr(ds du)] 

J n^oo 
U, 

since E(r(u") = f v „ u<r(ds du). The theorem is proved. 

Since [.. cr(ds du) - E(p(U t )) < oo, f — ^-^rcr{ds du) < oo. 
JU, ' ju, 1 + u z 

We have seen that lim f u 2 cr(ds du) < oo. Therefore lim f — - — r 



u» u? 
150 <r{ds du) < oo and we can also write the last equation as 

x t = g(t) + lim I M/jffifs du) -cr{dsdu) 

n^oo J L 1 + U 1 

[o,f]x(«:|«|>i) 
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where 

/u f w 3 
TO-{dsdu) - lim 
1 + M «^°° J 1 + i 
U, U? 

For simplicity we shall write 



-cr{ds du). 



up(ds du) 7rcr(ds du) 

\ + u 



Xt=g(t) + J J 
s=o —oo 

In the general case when x + 0, we have 

t CO 

Xf = X + g(t) + 

s=o -oo 

From now on we shall write 



u 



l oo 

II 



up(ds du) Ttr(ds du) 

1 + w 



X, 



OO 

= J up([o, 



u 



t] x du) -o-([o, t] x du) + g(t). 

1 + u 1 



Since has no fixed discontinuity P(\x t - x,_\ > 0) = 0. It fol- 
lows that cr{{t} x U) = 0. Noting this it is not difficult to see that 

TO-(ds du) and lim f.,„ -cr(dsdu) are both continuous in ?. 

Therefore is continuous hence is a Gaussian additive process. Fur- 
ther we can show that g(t) and f °° [up([o, t]] x du) ~ ?] x <j?m) 

J ~°° 1 + w 

are independent. We have 



/~«oo 

£(e ia! fe-^)) = £(exp(ia I [^([j,«]X(/h 

«Joo 



1 - U 



■o-([s, t] x du]))E(e 



ia\g(t)-g(s)] 



- lim £"(exp(/a I x <iw) "^-^r 

J|«|>i 1 - u 

I v(t) - v(s) 2 \ 
<t([s, t] x du])) x exp i(m(t) - m(s))a a 
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= lim exp f (e iau - 1 - -^r)cr([s, t] X du) 

«^°° |Jiwi>± a + U 

I v(t) - v{s) 2 \ 
X exp I ta(m(t) - m(s)) a I 



Therefore 

logE(e ia{x '- Xs) ) = ia[m(t) - m(s)] - V(0 ~ V(5) a 2 + 

oo 1 + W 

Since is Gaussian m(t) and v(f) are continuous in t and v(f) in- 
creases with t. 

Conversely, given m, v and cr such that (1) m(t) is continuous in t, (2) 

Xoo H 
^<r([o,t]x 
"°° 1 + u z 

du) < oo, we can construct a unique (in law) Levy process. 

Let us now consider some special cases. If J ^ u 2 cr{[o, t] x du) < oo 
we can write 

Xoo 
u[p([o, t] x dv) - cr([o, t] x du). 
oo 

The condition f°° — — — cr([o, t] x du) < oo is equivalent to the two 
J °° 1 + \u\ 

XOO H 
-cr([o, f] x du) < oo and (2) 
00 \ + u 

tO~([°> ? ] x du) < oo so that if I — cr([o, t] x <2w) 

oo 1 + U 2 J_oo 1 + M 



< OO 



we can write 



Xoo 
up([o, t] x du) + g2(t) 
oo 

log £(e !ax <) = -/am(0 - ---a 2 + [e' au - l]cr([o, f] X </«) 

^ J — CO 
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u 2 

poo U 



Xoo it 
— <x([o, t] x du) < oo is equivalent to the 
00 1 + \u\ 

2 3 

Xoo U foo U 
tCt([o, xdu) < 00 and (2) -tr([o, ?] X 
00 \ + u J ~°° \ + u 

u 2 

XOO 1/t 
— cr([o, ?] x du) < 00 we can write 
"°° 1 + \u\ 



log E(e iax >) = iamit) - -^-a l + [e ,au - 1 - iau]cr([o, t] x du) 



V 9 r oo ZCKW 

Lemma (). If f{a) - ima--a z + [e mu -\ -]cr(du) - 0, where 

2 J -°° 1 + u 1 

2 



Xoo U 
-cr(du) < 
00 1 + u l 

00, then m - v - o~ = 0. 



Proof We have = /(a) - £ J^ 1 f(fi)dfi = f + £~ e'^^M^) 
so that if 5„ is the Dirac measure at 0, 



00 

/[ v / sin u \ 
\-6 {du) + \\ —\o-(du) 



It follows that %6 (A) + jT (1 )cr(du) = 0. Taking A - {0}, 

r sinw 

since (1 )cr{du) - we see that v = 0. It then follows that 



S1I1M 

<x = and hence m = 



Form this lemma we can easily deduce that in the expression 

00 

\ogE(e iax <) = iam{t) - —a 2 + f - 1 - -^r]cr([o, f] x dw), 
2 J \ + u 



m(t), v{t) and cr are unique. 
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4 Temporally homogeneouos Levy processes 

We shall prove that if (x t ) is a temporally homogeneous Levy process, 
then log E(e' ax ') - tif/(a) where 



Definition (). Two random variables x and y on a probability space 
£l(P) are said to be equivalent in law and we write s~y if they yield 

the same distribution. 

A stochastic process (x t ,0 < t < a) on CI can be regarded as a 
measurable function into R^°' a \ Two stochastic processes (x t ), (y t ), < 
t < a are said to be equivalent in law if they induce the same probability 
distribution on R^ '"^ and we write x.~y.. If (x t ) and (y t ) are addtive 

processes such that x t - x s ~y t - y s , then we can be prove that x.~y.. 

Let D' denote the set of all <ii-type functions on [0,aO into R'. Then 
D' c R [Q ' a) and let B(D') be the induced Borel algebra on D' by B(# [0 ' a) ). 
If (x t , < t < a) is a Levy process then the map w — > x.(w) into D' is 
measurable; also if x\ ) = x x+ h - x t , < t < a - h we can show that (x t ) 
is temporally homogeneous if and only if x.~x ( . h \ 

Now consider D' . Let E e B + (S), 



and Ff(f) = number of points in /(/) n E t . 

We can show that F t (f) < oo and that F t is measurable on D' . The 
proof of measurability of F t follows exactly on the same lines as that of 
the mesurability of Yf. We have clearly p{E t ) -yf - Ff{x.). 

Let E e B([0, t]) and U e B(R') be such that E x = E x U e B+(5). 
If h is such that t + h < a we prove that cr((E + h) x U) = cr{E U). Let 
E 2 = {E + h)x U. Then a(E 2 X U) = E(y% h ) = E(y% h - ). Let - 
Xt+h-Xh- Since x f is temporally homogeneous x ( / !) ~x.. Also -yf - 

Ff'fx^] andyf 1 - Ff'[x.]. It follows that Eiyf 1 ) = E(yf* h ). Thus for 
fixed U, cr is a translation-invariant measure on B[(0,a))] and hence is 



i//(a) - ima - -a + + 



n 

U—oo L 



- 1 - 



1 +u 2 \ 




J(f) = {(s, u) : f(s) - f(s-) = utO},fD' 
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the Lebesgue measure, i.e. cr(E x U) = m{E)cri{U), where m(E) is 
the Lebesgue measure of E and cr\(U) is a constant depending on U. 
Since cr is a measure on R 2 , it follows that cr\ is also a measure. Hence 
cr(ds du) - dscr l (du). We shall drop the suffix 1 and use same symbol 
cr. Thus 



I oo 
-oo 



iau 



l+u 2 



cr{ds du) 



oo 

='f 



iau 



l+u 2 



cr(du). 



Now log E(e ia(x '~ x ^) depends only on t - s. Therefore m(t) - m(s) 
and v(t) - v(s) depend only on t - s. Hence m(t) - m.t, v(t) - v.t. 
Therefore, finally, 



log^fe""') = lm at 



vt 2 f°°r 
—a 1 + t \ \e 

2 J-ooL 



1 



iau 



l+u 2 



cr(du). 



We shall now consider some special cases of temporally homoge- 
neous Levy process. We have seen that 



x t = g(t) + up t (du) 



CO 



l + u- 



■tcr(du) 



where p t {du) - p([0, t] x du). Since g(t) is Gaussian additive and tem- 
porally homogeneous g(t) - mt + yJvB t , where B t is a Wiener process. 
Thus 



x t - mt + 



^B t + J 



up t (du) - 



l+u- 



■tcr(du) 



and 



\e iau -l- — 

oo L 1 

Special cases: 



iau 



+ u z 



cr(du) 



1. cr = 0. Then x, = mt + yJvB t . 
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2. In case m! - lim f . -r^cridu) existce, we can write x t - (m + 
m') + V^5f + f^, up t (du), and 

v r°° 

^(a) - i(m + m')a - -a 2 + [<? !au - \]cr{du). 

J — CO 

Note that if cr is symmetric, m' - 0. 

3. If m + m' = and v - 0,x t - lim f . upAdu) 

^(ar)=lim f [e~ faB - l]cr(dw) 

e -l- J|«|>£ 

Such a process is called a pure jump process. 

4. If A - cr(R') < oo, then 

XOO y-»CO 
Hp ( («/w), ^(or) - /I I - l]&(du) = yl[0(a) - 1] 

CO %J — CO 

where ©(£) = AT l cr(E) and 0(a) is the characteristic function of 
0. We have 

fk ik 

E(e iax >) = e'^ a = e~ At Y —6{a) k 
t—i kl 

k 

t k A k 

= e~ At ^ —j-^- x [characteristic function of ©**], 

where &* k denotes the k-fold convolution of 0. Since E{e mx ') is 
the chaacteristic function of the measure <p(t, .) we have 

<p{t,E) = e- M Y J ^-®* k {E)- 

k 

Remark. If <p(t,E) = P(x t e E) is symmtric, i.e. if P(x t e E) = P(-x t e 
E) then E(e iax ') is real. Hence \)/(a) is real. Further, since x t ~ - x t , we 

have x~ - x. It follows that cr(db) = cr(-db). Therefore 

v 2 r°° 

if/(a) - ima - -a + 2 J [cos aw - Y]cr{du). 

^ Jo 
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Since if/(a) is real m = 0, so that 

v r°° 

if/(a) - --a 2 + 2 I [cos aw - l]cr(ciw)- 
2 Jo 

5 Stable processes 

Let (x t , < t < oo) be a temporally homogeneous Levy process. If 
where c t is a constant depending on t we say that (x t ) is a staWe 

process. We shall now give a theorem which characterises stable process 
completely. From Levy's canonical form we have E(e' ax '^ = e'^ a ' where 



\e iau - 1 - — 
oo L 1 + 

Theorem 1. 



tau 

2 



cr(du). 



r lm a, m real 
-a \a\ 2 
(-a + i^ai)\a\ c , 



where ao > 0, < c2 and a\ is real. 

Proof. Suppose that i//(a) is not of the form Im a. 

(c d\ 

We prove that if ip(ca) - i[/(da) then c - d. For if e= min -, - < 

\d cj 

1 and tj/{a) - if/(e a) so that tj/{a) - i]/(e n a) — > 0. Hence if/{a) - and 
this is the omitted case. 

Since e^ c < a) = E{e ic ' aXl = E{e iax >) = e^ a) we have if/{c t a) = ti//(a). 
Therefore 

ifj(c ts a) - tsijj(a) = tip(c s a) = ip(c t c s a). 
It follows that c ts - c t c s . 

We prove next that c, is continuous. Let c tn — > d as t n — > t. If J = oo 
we should have, since ty(c tn a) - t n 4r(a), 

i//(a) = t n ifj(c~^a) 0. 
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Therefore d + oo and if/(c t a) = tif/(a) = lim t n if/(a) - limi[/(c,a) - 

n n 

if/(da). Hence limcf n = d = c t . One shows easily that c t - t l/c . There- 
fore if a > 0, 

.A(a.l) = (A((a c /M) = a c ifr(l), 

and if a < 0, 



<ff(a) = <A(M(-1) = MV(-l) = MV(1), 



for from the form of i//(a) we see that t//(a) = i]/{—a). Thus if if/(\) = 

-a + aiU we have \jj(a) = \a\ c (-a + ia\ — ). Since \e^ a >\ < l,a a > 0; 

\a\ 

ifa = 0, E(e iaxi ) = e ia ^ ar ' so that 

£'[cosq'(xi -ailal'" 1 )] = 1, 
i.e., Z?[l - cos a[x\ - ai|a| c_1 )] = 0. 

We should therefore have cosa(xi - ai|a| c_1 ) = 1 a.e. or a[x\(w) - 
ai\a\ ] = 2k(a,w)n, k(a,w) being an integer depending on a and w. 
For fixed w, thus k(a, w) is continuous in a. Letting a^Owe see that 
k(a,w) = 0. Therefore x\(w) - aiM c_1 = 0. If a\ + this shows that 
c = 1 so that ifj(a) = ia\a. 

We shall now show that o < c < 2. We have x t ~t'xi, x st ~(st)~ 

x\~scx t . By using additivity and homogeneity of x t and x st we can 

show that x s ~s?x. (as random processes). It follows that the expecta- 
tions of the number of jumps of these processes are the same (because 
if p\{E t ) and p2(E t ) correspond to x s and S l ^'x then p\{E t ),p2(E t ) are 
equivalent in law). The expected number of jumps of x s and s~x in 
dt du are sdtcr{du) and dtcr(S~ l/c du) respectively. We have therefore 

-1 /-CO 

cr{s~du) - scr{du). Let <r + (u) = cr(du) for u > 0. Then since 
s<r(du) - o-(s~ l/c du), 

cr(du) - I o-(s~ l/c du) = I cr(du) - o- + (us~ l/c \ 

a + 

Putting s = u c and a + - c<x + (l)(> 0) we get u c cr + (u) = cr + (l) = — , 

c 

so that cr + (w) - — u c . Therefore cr(du) = a + u c du. Similarly we see 

c 
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that cr(du) = a-\u\ c (u < 0). If a + - a_ = then if/(a) = ima - v/2a 2 

a 

and x t is Gaussian additive. Also ip(a) - \a\ c (-a + ia\ — ) so that 

\a\ 

c -2, v/2 - a and a\ - m = 0, Therefore if/(a) - -a„a 2 , a > 0. 

Let us now assume that at least one of a + or a_ is positive, say a+ . 

~i 2 du 



u c+1 



< oo. 



Since Jj 1 u 2 cr(du) < oo, u 2 cr{du) < oo, so that a + J^ 1 

l cr{du) < oo we can see that 
o < c. The theorem is completely proved. 

The number c is called the index of the stable process. We shall 
discuss the cases o < c < 1 , c - 1, and 1 < c < 2. □ 

Case (a) < c < 1. 

XCO pi 
M cr(dw) - oo, J |w|<x(dw) < oo. The second 

inequality implies ^Cj^ Mp([o, ?] x dw)) < oo so that 



P( | Mpflo, X dw) < oo) = 1. 

Let 



f(ri) = t I cr(du) = J cr([o, t]xdu) = E\ J t] X dw) 

= E\p\[o,t]x\\u\ > i 
Since is a Poisson variable we have 

Letting n — > oo, since /(n) — » oo we have 

P[p([o,f]x(N >o))>iV] - 1. 



p([o,t]x(\u\ >-))>N 
n 



= 2 g -/oo ^ )] * = i _ e -m ^ \M 



Hence P [the number of jumps in [o, t] - oo] = 1. Now f - 

J ~°° 1 + w 

cr(du) < oo, so that we can write 



<J — 



*t = 82(f) + ? ] x <^ M )- 
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We can now show that 



iff(a) = im - V -a 2 + a + I - 1]—^- + a_ I 

2 J M c+1 J_ 



" - 1] ,/;/ 



u\ c+l 



161 Also J °°(^" - 1)^ - a^V" - U^r = 0(|a|°) - 0(|a|) - 
0(H 2 ); similarly J° - 1)-^L - 0(|of) = 0(|a|) = 0(|a| 2 ) as 
a -» oo. Hence v = m = 0, and ifr(a) = a + f™[e iau -\]^r+a- f°Je iau - 

did poo 

^v^ir and x t= «, M ^(t°' x ^")- 

Case (b) 1 < c < 2 

/•oo Zi^ 

In this case — < oo. Hence we can write 

J -°° 1 + |w| |w| c+1 

iff (a) - ima - -a 2 + a + f \e' au - 1 - iau] 

2 Jo L J u c+[ 

+ a„ f \e iau -\-au\-p— 
J-oo L J W + 1 

Now if/(a) = 0(|a| c ), so that comparing the orders as a — > oo and 
ff-»owe see immediately that m - v = 0. Hence 

= £~ - 1 - H + - £ - 1 - H i^r- 

We have 

J i l«rV([o, f] x d M )J = a+f J | M | C ' + ma_? J ^ | M | cl , 

which is finite of infinite according as c' > o or c' < c. Therefore 
P[Ti \ x s ~ x s -\c' < oo] = 1 if c' > c. We can easily show that 

s<t 

E |exp |- |w| c ' p([o, t] X dw)JJ = exp |-r (1 - fT |M| V(dw)J 



j |w| c o-(cfw) = oo the right side is zero in the limit. It fol- 

rl 1 

162 lows that exp(- J \u\ c p([o, t] x du)) = with probability 1. Hence 
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p[i: s <t\xi - x s y =00] = me 1 < c . 

Case (c) c = 1 

We have if/(a) - ia\a - a \a\. Since 

-Il|a| = 2 I [coscra-1] — = I 



r Jau _ , _ jau_,du 



we have 



- zma ■ 



From the uniqueness of representation of i//(a) we get v = and 
cr{du) - In this case thus a + = a- and 



nJJ e 



(A(a) = /a!a+^ I \e' au - l - ? "" 



l +W 2 



^2" 



Definition (). Processes for which c = l are called Cauchy processes. 

6 Levy process as a Markov process 

Let (x t (w)), w e Q(B,p) be a temporally homogeneous Levy process. 
Let M = (R', W,P a ), where W = W dl and P a (B) = P(x. + a e B). We 
show that M is Markov process. 

If x is a random variable on a probability space Q, then the map 
(w, a) — > (x(w), a) is measurable. It follows that the map (w, a) — > x(w)+ 
a is measurable in the pair (w, a). Now note that if F is a fixed subset 
of Q. X R', then /(a) = P(w : (w, a) e F) is measurable in a. Hence 
P(w : x(w) + a € £") for E e B(R') is measurable in a. 

Therefore P(t, a, E) - P(w : x t (w) + a e £) is measurable in a. If [/ 
is an open set containing a, U - a is an open set containing 0. Since x t 
is continuous in probability 



limP(;,a, U) = lim P[x t (w) eU - a] = l. 

f->0 ?->0 
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It remains to prove that if t\ < ... < t n ,P a (x tj e \iri) - J ■ ■ ■ 

ajEEj 

J P(t\ , a, da\)P{t2 - h, a\ , da 2 ) . . . P(t„ - t n -\, a n -\, da n ) We prove this 
for n -2. We have, since x t2 - x tl ~x t2 - t\, 

J P(t\,a,dai)P(t 2 - t\,a\,da 2 ) 

aieEi a 2 eE 2 

- J P(t u a,dai)P(t 2 - h,auE 2 ) 

= J P(x h edai- a)P{x t2 _ n eE 2 -a{) 

a\&E\ 

- J P(x tl e da\ - a)P(x t2 - x h e E 2 — a - (a\ - a)) 

a,eE, 

= P[(x tl , x t2 -x tl )e (E 2 - a) 1 e ((E x -a)x R')] 

= P[x tl eEi-a, x t2 eE 2 -a] = P a [x tl e E\,x n e E 2 ] 

where(£ 2 - a)' - ?/) : ?/) e R 2 and ^ + r] e E 2 - a). 

Thus M is a Markov process. Further since H t f(a) = f(b)P(t, a, db) 
= Jf(a + b)P(x t e db), we see that H t (C(R')) c C(R'). M is thus 
strongly Markov. M is conservative. Recall that Wd { consists of all 
functions which are of d\ - type before their killing time. We have 

P a (o~co = oo) - P a (w : w(n) € R' for every integer n 

= lira P a (w(n) e R') = lim P(w : x„(w) eR') = \. 

n n 

Also M is translation invariant, i.e. if Tf,b = b + h then P Tha (ThB) = 
P a (B). 

Conversely any conservative translation invariant Markov process 
with state space R' can be got in the above way from a temporally ho- 
mogeneous Levy process. 

We shall now prove that the kernel of G a is the set of functions 
which are zero a.e., i.e.G a f - implies / = a. e. To prove this firstly 
onserve that G a f - implies H t f(a) - for almost all t. Hence we 
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can fined a sequence of t n I such that H tn f{d) = 0. Now J f(a + 
b)(p(t n ,db) - 0. Since / is bounded it is locally summable. Hence for 
any interval (or,/?) we have 



JJ f{a + b)ip{t n ,db) =0 

a 

i.e., = ff f(a + b)da<p(t n , db) 

a 

P+b 

= ff f(a)da<p(t n ,db) 

a+b 



g (bMt n ,db) = o 



P+b 

where g(b) - J f(a)da is continuous. It follows that J g(b)<p(t n ,db) — > 

a+b 

g(0) as t n — > i. e. f f(a)da - 0. Since this is true for every interval 
(a,/3),f = a. e. This proves our contention. 

Generator. It is difficult to determine the generator of this process in 

the general case. However we will determing <Su when u satisfies some 
conditions. 

Theorem 1. Let f(rj) = J e~ im f{a)da denote the Fourier transform of 

h 

f. Ifu - G a h with h e L'(— oo, oo), then u e L' and u . Therefore 

oc —if/ 

^Su e L' and ^Su - if/u. 

Proof Let ip(t, E) = P(x t e E). Then if / > we have 
J H t f(a)da = J da J f(a + b)ip{t, db) = J ip(t, db) J f(a + b)da 
= J <p(t,db) J f{a)da = J f(a)da 
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so that if / e L' so is H t f(a). Now H t f(a) is measurable in the pair 
(t, a). We have similarly if / > 0, 

oo 

J G a f(a)da = J da J e~ at H t f{a)dt 
o 

CO 

= J e- at dt J H t f{a)da 


CO 

= J e~ at dt J f(a)da - —f(a)da 


so that G a f(a) e L'. Therefore 

CO 

GJi(jj) = J e~ iaT1 da J e~ at dt J h(a + c)j](t, dc). 
o 

□ 

Since 

|J^y e^h(a + c)j^dadup<f,dc^ < JJj e~ at \h{a + c)\dadt<p{t,dc) 
- J G a \h(a)\da = — J ' \h(a)\da 
we can interchange the orders of integration as we like. We have 

oo OO ^ 

GaHji) - f e- at h{rj) f e^ c (p{t,dc)dt = f e^'h^e'^dt = k(jl) 
J J J a-ipOl) 

o o 

since J e iaa (p(t,da) - E(e iax ') = and since the real part of if/(a) is 

OO ^ 

non-positive f e'^'^^'dt exists and equals . Since u - G a h 

« - 

isjn L', 5fw e L'. Also from the last equation aG a h - h - if/G a h so that 

= i//u. 
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Corollary (). If a > and (a - ip)u - f for some function f € L' then 
u = G a f € and ¥u = \j/u. 



For we have from Theorem G a f 
G a f(a.e) and 'Su - \j/u. 



f 



a — iff 



it so that u 



Theorem 2. Ifu, u' and u" are in L' , then u e @(&) and u is given a.e. 
by 



oo 

, v ., f \ bu'(a) 

wuia) = mu (a) + —u (a) + u(a + b) - u{a) r 

2 J 1 + b l 



v r 

Proof Let /i - mu',f 2 = -u ",/ 3 = J 



/ ? 2 

«(a + ft) - w(a) - 



cr(db). 
bu'{a) 



\+b 2 



b 

cr{db). fa = f -u'(a)cr(db) and fa - f [u(a + b) - u(a) 

,,1, l + b 2 ,^1 



bu'(a)]cr(db). 



\u\<\ 



\b\<l 



From the hypothesis we see that f e L' ,i = 1,2,3, 4. We prove that 
/g exists and is in L' . We have 

r b 

u(a + b) - u(a) - bu'(a) = I u'(a + x)dx - bu'(a) 

Jo 

r b 

— I [u'(a + x) - u(a)]dx 
Jo 

b x 

= ^ dx ^ u"(a + y)dy. 



x=0 y=0 



Therefore 



Xda I \u(a + b) — u(a) — bu'(a)\cr(db) 
CO *J 

\b\<l 

oo b x 

< f da f cr{db) f dx f u"{a + y)dy 



\b\<\ x=o y=0 
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D A 

= J o-(db) J dx J dy J \u"(a + y)\da 

\b\<\ x=0 y=0 

b x 

-- J o-(db) J dx J dy\\u"\\ = i!y!l f < oo. 

|6|<1 *=0 v=0 \b\<l 



This shows that / 5 exists, is in L' and ||/ 5 || < f b 2 cr{db). We 

|i|<i 

can easily see that 



/i(t/) - Jmr}u(7]),f 2 (Ti) = -rfu(rj),fo{rj) 



u(rj) J [e^ - 1 - -^Wb) 

>l>l 



and 74(77) - rqu(rj) J -cr{db). Further f$ e L' and we have see 

|6|<l 1 + * 

that JJ \u(a + b) - u(a) - bu' (a)\cr(db)da exists as a double integral. 
Hence we can interchange the order of integration in 



ff 



e lT,a [u{a + b) — u(a) - bu (a)]o~(db)da. 



Thus we have 75(77) - J[e ir,a - 1 - irjb]u(rj)cr(db). Hence finally 

if / = fi + ■ ■ ■ + fs. An) + fijjj) + ■ ■ ■ + /sfa) = ^(77)^(77). We have 
[a - 1^(77)] 77(77) = au — f = au — f. Using the corollary of Theorem [fl 
we see that u e and u - G a [au - f] so that = au- {au - f) = 

f{a.e). This proves the theorem. 

Remark. If <p(t,E) is symmetric, &u(a) = —u"(a)+ C° [u(a + b) + u(a - 

b) - 2u(a)]cr(db). In the case of a symmetric Cauchy process v = and 
Wu(a) - J [u(a + b) + u(a — b) — 2u(a)]cr(db). 
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7 Multidimensional Levy processes 

A ^-dimensional stochastic process (x t ) is called a k-dimensional Levy 

process if, it is additive, almost all sample functions are d\ and it has no 

point of fixed discontinuity; note that unlike the k-dimensional Brown- 

ian motion the component process need not be independent. 

A ^-dimensional random variable x is called Gaussian if and only 
1 

i(m,d)- — (va,a) 

if E(e' {a,x >) = e 2 where m is a vector, v a positive definite 
matrix and (a, b) denotes the scalar product of a and b. 

Let x = (x l , . . . , x k ) be a ^-dimensional random variable such that 

for any real c\, . . . , c\, £ c,x ! is a Gaussian variable. Then x is also Gaus- 

v' 

„ , imfi- — fi 2 

sian. For E(e' p L ai ) - e 2 where m - £ aim 1 , V = £"((!] ai(x' - 

m')) 2 ) with m' - E(x'). Now v' = £ a^v« + 2 J] a i a jVij - (va, a) where 

»'</ 

v;y = E((x l - m l )(xi - mi)) and v = (v, 7 ). Since V > 0, v is a posi- 
tive definite matrix. Putting /? = 1 we have E(e'^ a ' x ^) = E(e'^ a ' x ') = 

Thus if almost all sample functions of a ^-dimensional Levy process 
(x t ) are continuous then x t - x s is Gaussian. 

Let (x t (w)) be a ^-dimensional Levy process. Proceeding exactly as 
in the case of k = 1 we can show that 



J l + i 



x r - + ^cr(ds du)]. 

' ' u- 

R k x[0,t] 



where g(t) is continuous; hence we can obtain 

logE(e Ka ' x,) ) = i(m(t),a) 



l -(v(t)a,a) + J U» • '" (< ^ ) 



R k x[Q,t] 



e 



\b\ 2 + 1 



cr{dsdb) 



If cr = the path functions are continuous. 

If (jc,) is rotation invariant i.e., if E(e l{ - a,Xt) ) - E(e^ a ' 0x '^) where is 
any rotation, we have, since (a,0~ l x t ) - (Oar, x t )(m(f), 0a) = (m(t),a) 
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and (v(t)0a, 0a) - (v(t)a, a). Since this is true for every rotation we 
should have m(t) = and v(t) a diagonal matrix in which all the diagonal 
elements are the same and we can write 



log E(e^) = -\v{t)\a\ 2 + J [e*>» - 1 - ^ 



cr(ds db). 



[0,t]xR k 



If the process is temporally homogeneous E(e ,( - a ' x,) ) = e'^ a ' where 



(//(a) = i(m, a) - -(va, a) + f 

z 



,i(a,b) _ 1 _ 



i(a, b) 



o-(db). 



l+b 2 

Now suppose that (x t ) is a stable process i. e. (x t ) is temporally 
homogeneous and x t ~c t x\ . We can show (proceeding in the same way as 

for k - 1) that cr(aE) - —cr(E) for a > 0. Now we prove that < c < 2 

a c 

unless cr = 0. Let E - (b : 1 > \b\ > -. Since J \b\ 2 cr(db) < oo we 

2 \b\<\ 

have 



n=o , .y , 



|fc|V(<#?) < oo 



so that 



i.e., 



Zj 2 2 \ 2" 2 2" 

n=Q x ' 



y -^o-(^-e\ < oo. 



Zj 2 2« \ 2" 

1 2 nc 
Hence since cr{rE) - — cr(E), we should have cr{E) Y> —z- < oo. If 
r c 2 ln 
cr{E) + 0, c < 2. Similarly considering J cr(db) < oo we can prove 

|fe|>i 

that c> 0. 

Let S denote the surface of the unit sphere in R k . Then R k minus 
the point (0, 0, ... , 0) can be regarded as the product of S and the half 
line (0, oo). For any Borel subset of S let c _1 o- + (0) = <x(0 x [1, oo])). 
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Then c _1 cr + (d0) is a measure on B(5) and 

1 

r 7 



: rCCT + (dG) 



_ 1 f 

- ~ J ~ <: 



[r,oo)x0 



It follows that cr(dfc) = — j-(r + (d0). 

If x t is rotation invariant cr + (dd) will be rotation invariant and hence 

drdO 

must be the uniform distribution dG so that cr{db) =const. t . 

We can consider a ^-dimensional temporally homogenous Levy pro- 
cess (x f ) as a Markov process with state space R k and we can prove 
that if / e L'(R k ) and u = G a f then (a - iflg))u(£) = f(g) = and 
&u(£) = if/(Ou(0- If u e L' and {a - f(g))u(g) e L' then u e and 
#w(£) = HZMZl To prove this let f = (a - <A(£))w(£> and v - G /. 
Then (a - ^(£))v = f = (a - MJ^))u so that u = v a.e. and u e ). 

Now suppose that (x ? ) is stable and rotation invariant. We can show 

a 

that Ma) - \a\ c il/{— ) so that if ^r(ar) is rotation invariant Ma) - -\a\ c , 171 
\a\ 

constant. If we look at the expression for i[/(a), we see that real part of 
i//(a) < 0. It follows that const. > 0. In this case we thus have 



c 



i.e., m = 

The Fourier transform (in the distribution sense) of \a\ c ~ k is n\%\~ c , 
k - c 

H - n^ k ^~ c T(c/2)/T( — — ) (refer to Theorie des distributions by Sch- 
wartz, page 113, Example 5). Since is bounded, it is a rapidly de- 
creasing distribution. Hence (see page 124, Theorie des distributions, 
Schwartz) 

utf) = A^(£)— J— (£> = A^m— j— = -— . 

r 1 1 
Therefore w(a) = A &u(b) ; — db. Thus ; — is the po- 

J \a-b\ k ~ c \a-b\ k ~ c F 

tential kernel corresponding to this process. Potentials with such kernels 

are called Reisz Potentials. 
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When c - 2, u(a) - A<£u * — r^r so that Au(a) = A^u * A — -r— 

a k ~ 2 a k ~ 2 



A^u{a). 



Section 5 

Stochastic Differential 
Equations 



1 Introduction 

The standard Brownian motion is a one-dimensional diffusion whose 

1 d 2 

generator is - — -. We shall here construct a more general one-dimen- 

2 da 1 

sional diffusion whose generator ^ is the differential operator 

1 , d 2 d 
D = -p\a)—r + r{a)—; 

2 da 1 da 

precisely if u € C2(R') - {u : u, u' , u" continuous and bounded} then u e 
S>(^) and &u = Du. To do this we consider the stochastic differential 
equation 

dx, - p(x t )dp, + r(x t )dt, 
where f3 t is a Wiener process. The meaning of the above equation is 

Xu r-u 
p(x s )dp s + I r{x s )ds, < t < u < oo. 

The meaning of f" p(x s )dfi s has to be made clear; we do this in 
article 3. Note that it cannot be interpreted as a Stieltjs integral for a 
fixed path because it can be shown that as a function of s,fi s is not of 
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bounded variation for almost all paths. We make the following formal 
considerations postponing the definition of the integral to § |3] 
173 Let xf be a solution of the differential equation with the initial con- 
dition Xq - a, i.e. let xf ) be a solution of the integral equation 



x t = a + | p(x s )dj3 s + | rLvjJ.v. 



Jo 



Then, under certain regularity conditions on p and r, we can define 
a strong Markov process M = (S,W,P a ) with S = R',W = W c <7?'), 
= P(x (a) € fi) and such that 

1 9 <i 2 w du 

<£u{a) = -P\a)— + r{a)—,ue C 2 {R ) 

2 da 1 da 

where 5f is the generator in the restricted sense. The same can be done in 
multi-dimensional case replacing (5, p, r by a multi-dimensional Wiener 
process, a matrix valued function and a vector valued function respec- 
tively. Componentwise we will have 

dx\ = V p l j(x t )d/3 J t + r l (x t )dt, i - l,...,n 

j 

and the generator will be given by 

ot f \ 1 V Hi x^ 2 ^) ^ V U \ du *^± 
^fl) = 5 ^i(fl)_ + ^(fl)_ 

i,j i 

where q 1 ^ = Y^p\p 3 k - 

k 

Taking local coordinates we can extend the above to the case in 
which the state space 5 is a manifold. 

Coming back to stochastic integrals we prove the following theorem 
which show that J f(s, w)d/3(s, w) cannot be interpreted as a Stieltjes 
integral. 

174 Theorem (). Let A be the subdivision t — sq < s\ < . , . < s n — u, and 
5(A) = max(j,+i - s{). Then 
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1. r 2 (A) = Z03O i+ i) - j8(jj)) 2 — > u — t l?-mean as 6(A) - 

2. r(/3, m) = sup J] -fi(si)\ - oo vwY/z probability 1. 

A ( 

Pratf (1) £(r 2 (A)) - 2 £[£(S i+ i) -/3(S;)] 2 = Zfei -*,■) = «-* 
and 

£(r 2 (A) 2 ) = £ EWsm)) -Pisdf) 

i 

+ 2 J] £(0S(^ +1 )) 2 06(^ +1 ) -P(sj)f) 

= J] 3(j i+1 - ^) 2 + 2 J] £(08(Ji + i) -y6(5,)) 2 ) 
E((fi(s j+l )-p( Sj )) 2 ) 



= ^ 3(^ + i - Si) 2 + 2^(^+1 - Si)(s j+ i - sj) 

i i<j 
i i 

+ ^2(> (+1 - Si)(s j+ i - sj) 

= 2^(i i+ i - *i) 2 + Ete+i - s ^f 

i 

because f3(si + i)-fi(si) and fi(sj+i)-fi(sj) are independent for / ^ j 
and £(06(O -/3(s)) 4 ) - 30 - s) 2 . We thus have 

£((r 2 (A) — (u — t)) 2 ) = E(r 2 (A) 2 ) - (u - t) 2 
= 2 - Si) 2 < 26(A) ^(sm - sd -» as 5(A) -» 0. 

i i 

(2) From (1) we can find a sequence A" = (? = s^ < . . . < s^ = u) 
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such that r2(A") — > u-t with probability 1. We have 

175 since 2 Ifljjjj ) - A^ n) )P -» m - * and max, £ ) -y6(^ l) )| -» 

because of continuity of path functions. 

□ 



2 Stochastic integral (1) Function spaces J?f 2 , <f s 

Let T be a time interval [u,v),0 < u < v < oo and /3 f , ? e T be a Wiener 
process i.e. (1) the sample functions are continous for almost all w, (2) 

P(J3 t -fi, €E) = j 1 e-*M-*dx and (3) fi tl ,/3 t2 -/?,, , . . . , - 

y8 ff! _j are independent if ?j < ... < t n e T. Let B f , ? e T be a monotone 
increasing system of Borel subalgebras of B such that B' includes all 
null sets for each t,fi t e (B ? ) and j3 t+ h -fit is independent of B' for h > 0. 
We shall use the notation / e (B) to denote that / is B-measurable. 

Let Jzf v be the set of all functions / such that (1) / is measurable in 
(t,w), (2) /, e (BO for almost all t e T and (3) f T j?dt < oo for almost 
all w eQ.. Instead of 3) we also consider the two stronger conditions 

( 3 ') Jn J T f(t,w) 2 dt dp < co 

(3") there exist a subdivision u - to < t\ < . . . < t n - v and M < oo 
such that 

ft(w) = f ti (w), U<t< t i+u < i < n - 1 
176 and \f t (w)\ < M. 

We define the function spaces Jz? 2 and £ by 



Jz^ 2 = {/: 1), 2) and 3') hold} 
# = {/: 1), 2) and 3") hold}. 



2. Stochastic integral (1) Function spaces S, J2? 2 , S s 



147 



Clearly g c Jz? 2 c J§? s . Jz? 2 is a (real) Hilbert space with the norm 
1 1/1 1 2 = J n J T \f\ 2 dtdp and Jz? v is a (real) Frechet space with the norm 

\\f\\j? s = / / Jj T \f\ 2 dt. "WfWX. 0" is equivalent to 

"f T \f\ 2 dt -> in probability" and if -f € Jz* 2 then ||/||^ < ||/||. 
Theorem LIS is dense in Jz? 2 {with the norm || ||) 
2 S 1 is dense in Jz? s (with the norm \\ \W S ). 

Proof. 1 . We shall prove that, given / e Jz? 2 there exists a sequence 
/„ e $ such that ||/„ - f\\ — > 0. We can assume that / is bounded. 
Put f(t, w) = for t T. Then / is defined for all t (this is to 
avoid changing T each time) and 

f°° f 2 dt dp < 00 so that f°° / 2 J? < 00 so almost all w. 

%J — OO %J— OO 

Therefore 



f 

«-/— O 



I/O + A) - /0)| 2 * -» as A -> 0. 



Also £ I/O + h) — f(t)\ 2 dt < 4 J" /(O 2 ^ e L'(fi). We get 



I/O + A) - /0)| 2 * dp -> as A -> 0. 



[2"f] 

If ^„(0 = — ,n > 1 then 177 



|/(j + (p„(t)) - f(s + f)\ 2 ds dp -> as « -> 00 



Also 



1/(5 + ^(0) -/(5 + /)| 2 djdP< 4 f(s) 2 dsdP. 

%J kJ —00 *y %J —00 
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Since T = [u, v) is a finite interval 



I I/O + <Pn(t)) - f(s + t)\ 2 ds dP dt -> as n -> oo. 

*JU—1 *J—oo 



i.e., 



+ ^„(?)) - f(s + t)\ 2 ds dP dt -> as n — > oo. 

oo Ju—\ J 

Therefore there exists a subsequence such taht 

£-1 Jn 1^ + ~ f( s + i)\ 2 dP dt -> for almost all 5. Choose 
s e [0, 1] and fix it. Then 

f I/O + (p ni (t)) - f(s + f)\ 2 dP dt -> as -> oo. 

J«-l 

Changing the variable 

v+s 

u-i+s n 
since < s < 1 

V 

J J |/(j + ^(f-j))-/(r)| 2 </P<fr-»0. 



u SI 



Let - f(s + ^ ra; - *))• Then hj e £ and p ( - - f\\ -> 0. 

2. Let / e Jzf s . We prove that there exista a sequence /„ e £ with 
Wfn-fW-^s —> 0. We can assume that / is bounded so that / e Jz^ 2 ; . 
We c an find /„ € £ such t hat \\f n - f\\ -» 0. But ||/„ - /||JS? 4 < 

L yll T \fn-f\ 2dt dp< ^f a f \fn-f\ 2 dtd P = \\f n -f\\^0. 
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Remark. Let f M be the truncation of / by M i.e. 



f - (fV - M) A M 



and for a subdivision A = (u - to < t\ <•••<*„ = v) let /a be 
the function/^ (/,w0 = f(ti,w),tj < t < f,-+i,0 < i < n - 1. Then 
the approximating functions /„ in the above theorem are of the form 
fn = ff n for some M n , A„. 

3 Stochastic Integral (II) Definitions and properties 

Let L 2 (Q) be the real L 2 -space with the usual L 2 - norm|| || and S(D.) be 

r 1 

the space of all measurable functions with the norm \\f\\ s - — ■ 

1 + 

\f(w)\dP(w). 5(Q) is a real Frechet space and "\\f\\ s — > 0" is equiv- 
alent to "/ -» in probobility". Clearly L 2 (Q) c 5(Q) and if / e 

L 2 (n),\\f\\s<\\f\\. 

We first define 1(f) = J T fdfi for / e S, show that it is continuous 
in the norms || ||, || ||. v and hence that it is extendable to Jz? 2 and Jzf s . 
We define for / e 8 



where to - u < t\ < . . . < t n - v is any subdivision by which / is 
expressed. This definition is independent of the division points with 
respcect to which / is expressed and 1(f) e L 2 (Q) c S(Q). That / is 
linear is easy to see and 



£(/(/)) = 2 E(f( ti )mt i+ i)) -m») = 2 EWiWWi+i) -m) = o 



since /(?,) and jS(?,+i) - fi(ti) are independent and E(fi(t)) - 0. 
Now we prove the following 

(A) ll/H = ||/(/)|| Though we use the same notation, note that 



n-l 



Kf) - f t dfit = > ftowtM) -m) 




feJ? 2 ,I(f)eL 2 (Q). 
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(B) \\I(f)\\s = 0(||/||J^ 1/3 ). 
Proof of (A). Let (/, g) - E(J fg dt). It is enough to show that 

T 

(f, g) = (HI), Kg))- 
Let /, g be expressed by the division points (/,)• Then 

(Kf)j(g)) = (Y J fiX i ,Y J sjXj) 

with fi = f(ti\ gj = g(tj), Xi = ftti+i) -P(U). Note that fi e (B") and X t 
is independent of B'\ We have 

W), 1(g)) = E(figi)E(Xf) + J] E(f igi XdE(Xj) 

i i<j 

= EY J E(f i g i )(t i+l -t i ) 

i 

= [J]figi(tM ~ td] =E^j fgdt^ = (f,g). 

Proof of (B). Let / be expressed by the division points (/,) and put f = 
f(U), Xi =fi(ti +i ) -p(td, A,- = t M - ti and 6 = \\f\\j? s . Then 



|J'./-. >e J 



< 6- 



.1+ e 



Let 



y . (lif Zj.»JlAj<e 
' \0 if Z j = fjAj>e. 

Then F; € (B n ) and since X, is independent of B n 



(n-\ 



2 YifiXi 



\i=0 



n-l 



\n-\ 



(=0 



(=0 
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since from the definition of F,-, Y 2 = F,-. Again From the definition of 

Yu^YijfAi < e 2 so that E(S 2 ) < e 2 , where S = Y^. Now 

P(|i| > rj) < e 2 /n 2 . If J T f 2 dt = ^if^i < ^ 2 then F = F x = . . . = 
F„_i = 1 so that 5 = Z ^/ = /(/)■ Therefore 



P(I(f)*S)<P if f 2 dt>e 2 



1+ € 

< 6 



P(\I(f)\ >n)< 5— + 4 



and 



\I(f)\<V \i(f)\>v 
1 + 6 e 2 

< T] + 5 + -r. 

£ 7] 

Putting 6 = 5 2/3 , 77 = eK we get ||/(/)||, < 45 1/3 . 

Using linearity of I and the fact \\I(f)\\ = ||/|| for / e S, we can 
extend 7 to J2? 2 (|| ||) [since <f is dence in J2? 2 (|| ||)] such that I is lienar. 
For / e J? 2 , 1(f) e L 2 (Q) and ||/|| = \\I(f)\\, and £(/(/)) = 0. 

The linearity of 7 and the fact \\I(f)\\ s < 4||/1|)^ 3 imply that we can 
extend 7 to the closure of $ in || \\& s i.e. to Jz? s . Since for / e Jzf 2 , 
\\f\\jf s ^ 11/11 we see that this extension coincides with the above for 
/ e J^ 2 . Further for / e Jz* we have \\I(f)\\ s < 4||/||^i/ 3 . 

Using the remark at the end of the previous article we can show that 
for / e j£f 2 

for some A„ - (/ (n) ), and M n . 

Finally if /, g, e££ s and if / = g on a measurable set Qi then 
/(/) = 7(g) a.e. Ql 
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4 Definition of stochastic integral (III) Continuous 
version 

Let B ( , < t < oo be a monotone increasing system of Borel subalgebras 
of B such that B f includes all null sets for each t. Let J3 t , < t < oo be a 
Wiener process such that f3 t e and /3 t+ h - fit is independent of B* for 
h>0. 

182 Let f t - f(w) - f(t, w), < t < oo be such that 

(1) / is measurable in the pair (t, w). 

(2) f t e (BO for almost all t. 

(3) £ f} dt < oo for almost all w e O for any finite interval [u, v] c 
[0, oo). Consider also the following conditions besides 1 and 2. 

(3') £ f} dt dP < oo for any finite interval [u, v] c [0, oo). 

(3") There exist point < to < t\ < t2 < ■ ■ . —> oo and constants 
Mi independent of w such that 

ft(w) = f(ti, w), \f(ti)\ < M h u<t< t M ,i > 0. 

In the same way as in J 2 we introduce theree function classes $ , 
if 2 and Jgf as follows 

# = {/: 1,2,3" hold} 
^ 2 = {f: 1,2,3 hold} 
JSf = {/: 1,2,3 hold }. 

From § 3 we can define v) = J" /(/, w)dfi(t, w), for / € if and 
for any bounded interval [u, v] c [0, oo). 
Now we shall show 

Theorem 1. I(u, v) has a continuous version in [u,v] i.e., there exists 
I(u, v) such that 

r 

P[I(u, v) = I fd jS\ = 1 for any pair (u, v) 

Ju 
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and I(u, v) is continuous in the pair (u, v) for almost all w; I(u, v) is 
uniquely determined in the sense that ifU(u, v) i = 1,2 satisfy the above 
conditions, then 

P[h(u, v) = l2(u,v)]for all u,v] = 1. 

Jrt 
fdfi has a continuous (in t) 

verson I*(t,f) in < t < v for any given v > 0, because I(u,v) = 

1(0, v) - 1(0, u). If / e £ then 7(0 itself is such a version and 

/>[sup |/a,/)|>e]<4dl/H 2 (1) 

0<?<v el 

where ||/ 2 || = £ j^fdt dP. □ 

To prove (1) let the restriction of / to [0, v) be expressed by the 
division set A = (0 = to < t\ < . . . < t n - v) and so, si, . . . be a dense 
set in [0, v) such that t\ — S[, < i < n. Let now T\ , . . . , r m (m > n) be a 
rearrangement of ao, si,...,s m in order of magnitudes. Then 

I(Ti,f) = Y,f^j^ T M^-^ T ^ 

Using arguments similar to those empolyed in the proof of Kolo- 
mogoroff 's inequality we can prove the following 

Lemma (). If x\ , . . . , x n , y\ , . . . , y n are random variables satisfying 

(1) yi is independent of(x u . . . ,x it yi, . . . 

(2) E(yi) = andE(xj), E(yj) < oo 
then 

k \ x 

maxl^x^U^ < -)^E(xl)E(y'). 
K i=l / 
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Thus we have 



i.e., 



p(max|/(Ti,/)|>6)<4 f f Z 2 ^^ 
vo<'<« / e 1 Jn Jo 

p(max|/(^/)|>6)<l||/|| 2 



Letting «-»oowe have (1). 

Let C s denote the space of all functions (h(t, w), < t < v, w e Q) 
which are continuous in [0,v] and introduce the norm || \\c s by 



\\h\L - ^ 



1 



, 1 + su Po<r<v \ h (t, w)\ o< f < v 
We shall prove that for / e $ 

l|/(/)lk = 0(||/||^l/3) 

1 



sup \h(t, w)\ 



(2) 



where 



WfH = e 



1 + 



i-l 



i'-l 



Define Y t = 1 if £ - f y ) < ^ and 7, = if 2 // (f,- +1 - ?y) > 

e 2 and let - Yjf(t) = Yifih) for t t < t < t M . Then g(t) e B ? and 

M 2 = I £ S 2 dt dP < e 2 and 
n 

P(I(t,f)) + I(t,g) for some ? e [0, v) = P \J fdt > e 2 



< 5- 



.1 + e 



where 8 = \\f\\j? s . Thus 



p[ sup |/(r,/)| > ??) < /?( sup |/(r,g)| > 77) + 5— < ^ + 5 

\0<f<v / \0<f<v / € T 



1 +6 



from (1). Therefore 



e ?7 Z 
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Putting e - S 2/3 and n - ez we get 

< e*[2 + 6 + e3 < 4e X 2= 0(e*) = 0(£ 1/3 ) = 0(||/||^). 

Since C s is complete in the norm || || Cj we can extend the mapping 

S3f^ /(.,/) eC s 

to the closure of £ with respect to || i.e. to L s . This extension gives 
the continuous version of I(t, f), < t < v. Since (2) is also true for this 
extension, we have 

Theorem 2. If 

\fn - f\ 2 dt — > in probability 
then sup \I(t,f n ) - I(t,f)\ — > in probability. 

0<t<v 

For any Borel set E e [w, v) we define 

Je Jo 
For / € Jzf 2 we have seen that 

H/(f,/)ll - 11/11- 

Let / e Jzf v and consider the truncation f M . Since \f M - f\ 2 XE 
ds — > we see that sup /^) - f M XE)\ — » in probability. 

«<f<v 

Since Xe/ M ^ 2 we have, if Z? has Lebesgue measure zero 

l|/a,/ M *£)ll = f E(f M ) XE ds = Q. 
Jo 

Thus J /e<i/^ = if the Lebesgue measure of E is zero. 

E 

Remark. Henceforth when we speak of the stochastic integral we shall 
always understand it to mean the continuous version. 



I 
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If f e J£ 2 we have 
Theorem 3. Iff e ^ 2 and e > 0, 

wa,/)iu > e] < 4ii/ii 2 

wAere \\\I(t,f)\\\ = sup ||/(f,/||). 

0<r<v 

Proof. Let /„ e ^ be such that ||/„ - /|| -> 0. Then for any 5 > 0. 

OT(f,/«-/)lll><$]-»0 (1) 
For g € $ we have proved that 

Wa,g)lll>e]<-UgH 2 (2) 

Therefore if 77 > 0, 

/)lll > e + 77] < /„ - /)lll + fn)\\\ >e + 7 1 ] 

<[\\\I(t,fn-f)\\\]+P[\\\I(t,fn)\\\>e] 

<P[\\\I(t,fn-f)\\\>J]] + \\\fn\\ 2 , 



1 

7 2 



from (2). From (1) if n -» oo,P[|||/(r,/)||| > 6 + 77] < ^||/|| 2 . Letting 
j] — > 00 we get the result. 

5 Stochstic differentials 

Let /3 f , /3 f be defines as before. If x t - xq + f s d /3 S + where 
xo(w) e B° and 

1 . /, g are measurable in the pair (t, w) 

2. f, g s e (I s ) for almost all s, < s < 00 

3. fgds < 00, \g s \ds < 00 for almost all w, for any finite t then 
we write 

dx t = fdfit + g t dt. 
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If dxt = ftdPt + gtdt, dx\ = fidfr + g\dt, ft = E; <fiff, ft = 2 + 

i 

^(0 then we shall write 

dx t = ^ (p\dx\ + i/^cff. 

£ 

Theorem (). IfFtf 1 , ...,(*,t) is C 2 in (£\ ) and C 1 in t, if dx\ = 

f}d t + g' t dt and ify, = F{x] , . . . , x\ , t), then 



where 




Remark. We can get the result formally as follows: 

1. Expand dy t i.e. dy t = dF(x), . . . ,x^,t) - Y^F[dx\ + F^+idt + 

i 

1 k . . 

- £ fjdx'tdxj + ■■■ 

Z ij= 1 

2. Put dx\ = f}d/3 t + g\dt. 

3. Use dfa - Vdi 

4. Ignore 0(dt). 

Lemma 1. If f, g e ££ s (as defined in §0 then 



u 


u 


J fsdps 


J € s dj3 s 


- 1 


- 1 



where 



J e s dJ3 s = J f s G s d/3 s + J g s F s dp s + J f s g s ds, 
it t t 

s s 

F s = J fedJ3 8 ,G s J g e dfo. 
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Proof. 

Case 1. /, g e $ (as defined in §0). 

We can express / and g by the same set of division points A = 
it = tf < . . . < = u). Now let A„ = {t = < /f° < • • • < 4 n) - 
> m) be a sequence of sets of division points containing A such that 
8{K) = max |<W _ _> o. Put J&~> = f(tf), if = g(tf), B { f> = 

0<!<n-l ,+1 1 i i i i i 

B{t^ x )-B{fl). We have 





u 










J gsdB s 








. f 











n-l 



n-l 



n-l 



1=1 



1=1 



!=0 



Put <p„0) = for /f° < s < t\l\ and let G n , F„ be defined as 

G n (S,W) = G((p n (S),w),F n (s,w) = F(<p n (s),w). 

Then G,„ F n € $ and since the set A„ contains A m , /G„, gF„ e 
Thus 



n-l 



J /^.vj g^8, = J f(s)G n (s)dB s + J gsFndBs+^X^YfiBf 
t t t t 1=0 

u u 

Now j \f(s)G(<p n (s)) - f(s)G(s)\ 2 ds < max \G n (s) - G(s)\ f \f(s)\ 2 

J t<s<u J f 

ds — > with probabulity 1 since G(s) is continuous in s. Similarly 
J" \g(s)F n (s) - g(s)F(s)\ 2 ds — » with probability 1. Further 

n-l 



i=0 ; 
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+ 2 ^ e h&h^xfyf \(b^) 2 - [(sf ) 2 - ( t W - ) 



/'=o 



since E((B\ ') ) - - t) 



n-\ 



2 J] E((X?°lf )(f<*> - tff < 2S(A n )E ^"M"^! - 



i=0 



.i'=0 



= 25(A n )E 



J f\s)g 2 {s)ds 



since 



2(W) 2 (« ) 1 -<f )= f /Ww. 

i=0 , 



The lemma for f,geS, then follows Theorem|2]of §0J 
Case 2. Let /, g e 5£ s . There exist sequences /„, g n e $ such that 

u u 

J \fn ~ f\ 2 ds and J \g„ - g\ 2 ds -> in probability. 

r r 

Therefore sup \F n - F\ and sup \G n - G\ —> in probability 

t<s<u s t<s<u s 

s s 

where F(j) = / f(6)dB e ,G(s) = j g{6)dB e ,F n (s) = j f„(0)dB e ,g n ( S ) = 

t t t 

J t g n {B)dBg. Choosing a subsequene if necessary we can assume that 
the above limits are true almost every where. Then for any w 

u u u 

J \f n G„ - fG\ds < 2 J \f n - f\ 2 G 2 n ds + 2 J f\G n - G\ 2 ds 



pu 

< 2 sup G 2 n (s) \f n - f\ 2 ds + 2 sup \G n - G\ 2 \ fds 0. 

t<s<u Jt t<s<u 



11 

!■ 



The proof of the lemma can be completed easily. 
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Proceeding on the same lines and noting that f(t\ n) )g(t\ f)(P(tf\) 
- Pit^Wll] - t ( " } ) -» 0, for /^e<f,asfi^oowe can prove 

Lemma 2. (j" f s d/3 s )(f" g s ds) = Jf f s G s dj3 s + f" g s F s ds where F s = 
f' fedfie, G s = f* g e d e . 

Proof of Theorem. Write F(xj ,...,x),t) = F(x t ). Let A n = (0 = rg° < 
< < . . . < t n n) - t) be a sequence of sub divisions such that 
6(A n ) -> 0. Then 



n-l k 



n-l 



+ 



Sfl) 
l+l 




+ 



\ Z Z f <j W°>) Wl) - ^! n) )) MS> - ^)) 



/=0 i,j=l 



/=0 i,/=l 



* ^ 1 \ i 1 \ i 

- m + Z 4 + 7 « + 2 Z 7 i + 2 Z 4' sa y- 




From the hypotheses on F and the continuity of x J (t), 



e , — > uniformly in /, j, I as « — > oo. 



Let <p„(f) = for tf> < t < tjl\. Then we have 



n-l "+ 1 

4 = Z F < (x( '!" ))) ^ + 




Fi(x( Vn (s)))f s dfi s + Fi{x^ n {s)))g' s ds 
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J FiiMfPnisMfidfl, + J FM<p H (s)))gids. 





Also 



f |F ; (x(^(5))) - F,ix(s))\ 2 (fi) 2 ds 
Jo 



o<s<r 

for every w. Thus 

t ft 



< max \Fi(x(<p n (s))) - F,(x(s))| 2 x f {fy 2 ds -> 

Jo 



f Fi(x(s))fidfi s + f F,(x(*))g ! > 
ti ti L Jo Jo 



in probability. Similarly 



/„ 2 - f 
Jo 





Using Lemma [2 and |2 we have 

(x\v) - x ! '(m))(^(v) - x j (u)) 



: [f' s (X j (s) ~ X'{U)) + fiix'is) - *"'(«)]#, 

V v f s ^ 

+ J + J g* J fide <is 

u it V u ) 

V ( S \ f V \ / V ^ 

+ / ^ + / S l s ds J gids 

It V U ) V U / V H / 

v v 

= J [/fr^co - a •'(»» + //(AiM - a •'(»)) | ,//;. + J' /; //'/ v 

if U 

V 

j Yb+giiYl-rjjds 
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since 



\j &A\f gids\ = J Af gide\ + j gi\f faeUs 

\u J V u J u V u J u \u ) 

s s 

where F< = f[f e + dO, Y J S = J [// + g J e ] dO. 



Thus 



If, 



,„ = j Fij(x(<p n {s))) [f s {x\s) - x\s))) + fhAs) - x\<p n (s)))] dp s 



t t 
+ J" l n( y(y„(s)))f:f: l ls + J" Fijixitpnis))) 



[g^is) - Yj(<p n (s))) + g j s (r(s) - YX<p n (s))j\ ds^ J F u (x(s))f'fids 



in probability because othet terms can, without difficulty, be shown, to 
tend to zero in probability. Again 



n-\ 



/=() 

In the same ways as above we can show that 

n-l 



/=() 



Thus \lf. | — > in probability. We have proved the theorem 

IJfl 
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6 Stochastic differential equations 

The notation in this article is as in the previous ones. 
Theorem 1. Let p{%), r(£), ^ e R' satisfying Lipschitz, condition 
\pi€) - P(V)\ < A|f - n\, Kf) - r(77)| < A|f - 

Then 

dx t - p(x t )d/3 t + r(x t )dt, xq(w) = a(w) e B° 
has one and olny one solution. 

[\a(w)\ < oofor almost all w] 

Proof. (a) Existence. We show that 

t t 
x,(w) =«. ( w ) + J p(x s )dp s + J r(x s )ds 



has a solution. We use successive approximation to get a solution. 
Let cc M (w) be the truncation of oc at M (i.e., (oc V - M) A M) and 
put 

x°(t,w) =oc M ( w ). 
Define by induction on k 

t t 
x k+ \t,w) = a M (w) + j p(x k s W s + j r{x k s )ds 



= a M +y*(t) + z*(t), say. 
Note that if / e Jz^ 2 then I(t, f) e Jz* 2 and 



E(\I(t,f)\ 2 ) = J E(\f(s)\ 2 )ds, 
o 
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t 

where I(t,f) - J f s d/3 s . From the hypotheses on p and r, 



x k (t, w) e Jz^ 2 for all k. Now 
E{\x k+ \t)-x\t))\ 2 ) 

< 2E [\y k (t) - y k ~ l (t)\ 2 + 2E [\z k (t) - z k ~\t)\ 2 ^ 

<2 f E(\p(As))-p(^~\s))\ 2 )ds 
Jo 

+ 2tE ^ \r{x k {s)-r{x k ~\s))\ 2 ds)^ 

t 

since \z k (t) - z k '\t)\ 2 < t J \r(x k (s)) - r(x k -\s))\ 2 ds 

o 

t 

< 2A 2 (1 +t) J E(\x k (s) - x k ~\s)\ 2 )ds 

o 

t 

< 2A 2 (1 + v) J E{\x k ~ l - 4 _1 | 2 )^ 

o 

where < t < v < oo and v is fixed for the present. Therefore 

E(\x k+1 (t) - x k (t)\ 2 ) < [2A 2 (1 + v)]* / ds x Jds 2 . . . ^EdxHsk) - 



x°(x k )\ 2 )ds k 

t Sk-l 

< [2A 2 (1 + v)]* J dsi... j 2E(p 2 (a M )s k + r 2 (a M )s 2 )ds k 


r Jc+\ 
= [2A 2 (1 + v )] k 2\E{p 2 {a M ))—— + 2£(r 2 (a M )) 



(k + 2) 



which gives 



J* E(\x k+l (9)-x k (9)\ 2 )d8 
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,1+2 ,,k+3 



< 2 [2A^( 1 + v,] E {P \ a - )} — + 2 £ (,^»))— ] 



Let |||FO,w)||| = sup \F(t,w). Then 

0</<v 

>e] 

< P - /"HOIII > | + P [\\\z k (t) - z k - l (t)\\\ > I 

V 

^[Kp^))-^- 1 ^))! 2 ]^ 



v 

+ ^vJe [\r(x k (s)) - r{x k '\s)f] ds. 


(from Theorem |5] of §HJl 

4A 2 (1 + v) 
-2 



e 2 



fc-l 



[2A 2 (l+v)] 
S [2A 2 v(l + v)]* 



e 



2 ft! 



,1+1 ,,£+2 

where 5 = 2 [£(P 2 (or M ))v + 2v 2 E{r 2 {a M ))\ . 



[2A 2 v(l + v)] k/3 
PUttmg €k = We get 



P[|||** +1 (f)-;c*(f)||| >£k]<Be k . 



□ 



Since £ is a convergent series Borel-Cantelli lemma implies that, 
with probability 1, w belongs only to a finite number of sets in the 
bracket of the last inequality. Therefore 

P[\\\J + \t) ~ AOIII <^k for all k > some I] = 1. 

Since £ < oo, we get 
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\\\x m (t) - x"(t)\\\ -> o with probability lasm,n ^ oo i.e., P[x k (f) 
converges uniformly for < t < v] = 1 . 
Taking v = 1, 2, 3, ... we get 

P[x k (t) converges unifolmly for < t < n] for every n] - 1. Let 
x M (t, w) be the limit of x k (t, w). This is clearly continuous in t for almost 
all w. Also for any v < oo, 

P [|||jc*C0 - * M (0III -» as it -» oo] = 1. 

so that p(x k (s))dB s — > p(x M )(s))dB s in probability. Now we prove 
without difficulty that 



X M (t,w) = a M (w) + 



J' p(x M (s,w))dB(s,w) + J r(x M (s, 




w))ds. 



Let Q.m = (w : \a(w)\ < M) and define x(t,w) = x M (t,w) on n«. 
If M < M' then on H^, or M = o- M so that from the construction [and 
the fact that if / = g on a measurable set B then I(t, f) - I(t, g) a.e. 
on B] it follows that x M (t, w) = x M '(t,w). Also since on Q.M,x(t,w) - 
x M (t, w), x(t, w) is a solution. 

(b) Uniqueness. Let 

x t - a + I p(x s )dB s + I r(x s )ds < t < v, a e (B°). 
Jo Jo 

= a + f p(y s )dB s + f r(y s )ds 
Jo Jo 



Case 1. E(xj ) and £"(3^ ) are bounded by some G < 00 for < t < v. We 
have 



E((x(t) - y{t)f) < 2E ^f\p(x(s)) - p(y(s)))dB(s) 
+ 2E^J\r(x(s))-r(y(s)))ds j 
< 2 f E([(p(x(s)) - p(y(s))) 2 } ds + 2t £ E [(r(x(s)) - r(y(s))) 2 } ds 
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since [j^ ^(s)^] < t <p 2 {s)ds. Thus 

E [(x t - y t f] < 2A 2 (1 + t) £ E [(x, - y s ) 2 } ds 

<2A 2 (1 +v) E[{x s -y s f]ds 

put C t = E((x t - y t ) 2 ) [< AG 2 ]. Then 

C t < 2A 2 (1 + v) c s ds < [2A 2 (1 + v)] 2 J ds J c e d e < ■ ■ ■ 



Therefore 



[2^(l + v)] V4G2 ^ 0as ^^ 



Case 2. Let x tM = (x t AM)V(-M),y tM - (y,AM)V(-M) and a M - (aV- 
M)AM. Define x°, x 1 , . . . . . ., inductively as follows 

x° t = x tM , - a M + f p(x n s )d/3 s + f r{j? s )ds 

Jo Jo 

y° t = JtM,yT l =a M + fp(y n s )d{3 s + C r(y n s )ds. 

Jo Jo 

Arguments similar to those used in the proof of existence of a solu- 
tion prove that 

x, = lim x", y t = lim y" 



exist and 



x,-a M + \ p{x s )dp s + J r(x s )ds 

Jo Jo 

y t (t) = a M + I p(y s )dJ3 s + I r(y s )ds 

Jo Jo 
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and 

sup E(x 2 ) < oo, sup E(y 2 ) < oo. 

0<f<v 0<t<v 

Therefore from Case 1 , x t - y t for < t < v. 

Let £1m = (w : \a\ < M, sup | x t \< M, sup | y t \< M). Then since 

0</<\' G<t<v 

x t and y, have continuous paths p[Um^m] - 1- But on Q.m, 



y t = y t M = y° t = y) = • ■ ■} 

x t = x tM — Xf = X t = • • • I 



< t < v 



Note that if /, g e £ s and / = g on a measurable subset B then 
I(t,f) = I(t,g) on B with probability 1. 

Thus x t = y t on Q.M- We have proved the theorem. 

Corollary (). Let a(w) € L 2 (Q) and x(t, w) satisfy 

x(t, w) - a(w) + I p(x(s, w)dB(s, w) + I r(x(s, w))ds. 

Jo Jo 

Then 

E{x]) < Be^ for < / < v 
where B - 3E(a 2 ) + 6vp 2 (0) + 6v 2 r 2 (0) and // = 6A 2 (1 + v). 

Proof. From the proof of Theorem ffl we gather that x(t, w) e £} (for 
any v < oo). If | x{f)f = E{\ x(t)\ 2 ), 



\\x(t) ~ .v(.v)|| 2 : 2 J E(p(x(0)) 2 )d6 + 2(t - s) J E(rixW)) 2 uW 



so that ||x(?)|| 2 is continuous in t. Let / = sup ||x,|| 2 . 

0<t<v 

Now 

||x r || 2 < 3E(a 2 ) + 3 f E(p(x(s)) 2 )ds + 3t f E(r(x(s)) 2 )ds 

*Jo *Jo 



< 3E{a 2 ) + 6[^ 2 (0) + t 2 r 2 (0)] + 6A 2 (1 + i) \ \\x(si)\\ 2 ds\. 



Jo 
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i f\\x( 

Jo 



<P + fi I WrtsfifdsnZfi + ii f ds x [fi + n f 1 \\x(s 2 )\\ 2 ds 2 ] 

*Jo *Jo 



= p(l+pt) + 



\x(s 2 )\\ 2 ds 2 <Ai +nt) 



1 + 



ft fb 1 

p 2 ds x 

Jo Jo 

ft fS i I fS2 

+ p 2 ds { ds 2 \/3 + fi \ ||x(s 3 )|| 2 <5?s 3 
Jo Jo Y Jo 

fit + —\+ J dsi J ds 2 J o 114^3)11^3 
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Continuting this, for any n we have 

H n t n 



iwoir <fi \\+fit+ 



fPf_ 

2! 



+ • • • + 



->5„ 



+ H 



n+\ 



ft fi>i fS n 

\ dsi \ ds 2 ...\ \\x(s n +i)\\ 2 ds n +\ 
Jo Jo Jo 

:^'+p n+l fd Sl ... f "\\x(s n+1 )\\ 2 ds n+1 <^'+p n+l l-^ 
Jo Jo (n + 



Q.E.D. 



Theorem 2. There exists a function x(t, a, w) measurable in the pair 
(a, w) such that for every fixed a e R l , 



x(t, a,w) = a + I 
Jo 



p(x(s, a, w))d/3(s, w) + I r(x(s, a, w))ds 



f 

Jo 



for every t and for almost all w. That is there exists a version of the 
solutin of 

dx t = p(x t )dj3 t + r(x t )dt, x(0) = a 
which is measurable in the pair (a, w). 

Proof. Let x°(t,a,w) - a.x Q (t,a,w) is measurable in the pair (a,w). 
Assume that x l ,...,x k have been defined, are measurable in the pair 201 
(a, w) and for every fixed a 



f 

Jo 



x\t,a,k) = a+ I p{x' 1 (s,a,w))df3(s,w) 
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I r(x' i {s,a, 
Jo 



w))ds, 1 < i < k. 



for almost all w and for all t. We shall define x k+l . Let A" = (0 = 

s" < s" < . . .) be a sequence of subdivisions of [0, oo) such that 6 n 

n _ c «| 

i 

uous in s for almost all w, 



sup \s" . - s"\ tends to zero. Let v < oo. Then since x k (s, a, w) is contin 



I |/?(jc*0, a, w)) - pip^iifn^s), a, w))\ 2 ds -» 
Jo 

for almost all w, where </>„(/) = s? for s" < t < s? v Hence 

sup \ J^[p(x k (s,a,w)) - p{x k ((p n (s),a,w))]df3 s — > 0] in probabil- 

0<f<v 

ity. By the diagonal process we can find a subsequence nj suet that 

p[sup \f'p(x k (s,a,w))d(3 s - C ptd c (<p n j(.s),a,wy)dfi s \ -> for every 

0<f<v 
V < oo] = 1 

Since pi^{fp n ji.s), a, w)) e £ L pi^iipnjis), a, w) is measurable in 

(a,w). It follows that M(t,a,w) = lim L p(x*(<p n j(s),a, w))dfi s is mea- 
surable in (a, w). Now define 



x K+l (t,a, w) - a + M(t,a, w) + J r(x*( s, a, w))ds. 

Jo 

Proceeding as in Theorem [l] we can show that x k (t,a,w) converges 
with probability 1. Let now 

x(t, a, w) - limx^, a, w) 

We can show that x(t, a, w) is the required function. □ 

Remark. We can easily prove that if then x(t, a n ,w) — > x(t, a, w) 

in probability. In fact 



E(\x(t, a, w) - x(t, a n , w)| 2 ) < 3\a - a n \ 2 + 3 I EQp(x(s, a n , w) 



T' 

Jo 
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- p{x(s, a, w))\ 2 )ds + 3? I E(\r(x(s, a n ,w)) - r(x(s, a, w))\ 2 )ds 
Jo 

so that 

lim E \lx(t, a, w) - x(t, a n , w)\ 2 ] < 3A 2 (1 + t) 

a„— >a L I 

E(\x(s, a n , w) - x(s, a, w)\ 2 )ds 
and now using the corollary to Theorem [2 and Fatou lemma we get 



lim I j 



lim E[lx(t, a, w) - x(t, a n , w)\ 2 ] 

a„^>a 



V 

< 3A Z (1 + t) I lim E(\n(s, a n , w) - x(s, a, w)\ 2 )ds 

a„^>a 



Q.E.D. 



Theorem 3. Let x(t, a, w) be as in Theorem\2\and x(t, w) be the solution 
of 

dx, = p{x t )dj3 t + r{x t )dt, x(o, w) - a(w), a(w) e (B°) 

Then 

p[x(t, a(w), w) = x(t, w)] = 1 
Proof. We shall prove that 

x(t, a(w), w) = a(w) + I p(x(s, a(w), w))dfi(s, w) + I r(x(s, ar(vv), w))ds 
Jo Jo 

with probability 1; then by uniqueness part of Theorem fflthe result will 
follow. 

1. Since x(t, a, w) is measurable in (a, w), x(t, a(w), w) is measurable 
in w. In fact, x(t, a(w), w) is the composite of 

w — > (a(w), w) and (a, w) — > x(t, a, w). 

2. Consider the function-space valued random variable 
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This induces a measure on C, the space of all continuous functions 
on [0, oo) and with respect to this measure the set of coordinate functions 
is a Wiener process i.e., if for w e C 

fi(t,w) = w(t) 

then P(t, w) is a Wiener process on C. Let B' correspond to W. There 
exists a unique solution of the equation 

dx t = p(x t )d/3(t) + r(x t )dt, x () = a. 

i.e., x(t, a, w) - a + I p(x(s, a, w))dj3(s, w) + I r(x(s, a, w))ds 
Jo Jo 

204 for almost all w. Hence we have by uniqueness 

x(t, a, w) = x(t, a,f}(w)) a.e. 
Let L(a, w) = x(t, a, w) and 

R(a, w) = a + I p(x(s, a, w))dj3(s, w) + I r(x(s, a, w))ds 
Jo Jo 

If a(w) e (B°) then a(w) and fi(w) are independent. Hence the mea- 
sure induced by (a, ft) onR 1 x C is the product P a x Pp where P a is the 
distribution of a and Pp is the probability induced on C by /?. Hence we 
have 

P[w : x(t, a(w), w) = a(w) + I p(x(s, a(w), w)dfi(s, w) 

Jo 

+ I r(x(s, a(w), w)ds 
Jo 

= (Pa x J P /? )[(a, w) : L(a, w) - 7?(a, w)] 
Jr 

= f l.P a (da) = l. 
Jr 

This proves the theorem. □ 
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7 Construction of diffusion 

In this article we shall answer the question of §^i.e. we shall prove that 
if p and r satisfy Lipschitz condition then there exists a diffusion with 

state space R' such that if u, u' , u" are continuous, u and ~jP lu " + ru ' 
are bounded and 'S is the generator in the restricted sense, then 

(gu = -P 2 u" + ru. 
2 

We have proved in ^5]that 

x{t) = a + I p{x(s))dB{s) + J r(x{s))ds 
Jo Jo 

has a unique solution x(t, a, w). Let S = R',W = W c (R l ) and 205 
P a (B) - P(w : *(., a, w) eB),Be B(W). 
Then M = (5, W, P a ) is a diffusion. 

We shall first prove that M is a Markov process. We verify the 
Markov property of P a . 

Let Pj(w) denote the stopped path at t of /?(., w) i.e. (3(tA., w) and let 
B'{w) = p(t + „w) -P(t,w), p"{s,w) = P(t + s,w), B" e = B t+f> . Then 
B"{s, w) is also a Wiener process on O. Let x(t, a, w), y(t, a, w) denote 
solutions with respect to these processes of 

dz t = p(z t )dB t + r(z t )dt 

i.e. 

x(t,a,w)=a+ I p(x(s, a, w))dB{s, w) + I r(x(s, a,w))ds 
Jo Jo 

y{t,b,w)=b+ J p(y{s,b,w))dB"{s,w) + J r(y(i, ft, w))«i5 
Jo Jo 

If jS(w) = 8{.,w) - B(0,w) then B(w) and /3'(w) induce the same 
probability on C. Hence (see the proof of Theorem|5]of §H5 

x(t,a,w) = x(t,a,B(w)),y(t,a,w) = x(t,a,B'(w)). 
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Consider the C-valued random variable fc(w). This induces a prob- 
ability on C and with respect to this the process 

fi(s, w) = < s < t 

is a Wiener process on C and there exists a unique solution for 

dx s = p(x s )df3 s + r(x s )ds, xq = a, < s < t 

i.e. there exists f(s, a, w) such that 

f(s, a,w) = a+ f p{f{6, a, w))dfi(8, w)+ [ r(f(9, a, w))d9, 0<s<t. 
Jo Jo 

Then we have 

f(s,a,ft(w))=a+ f p(f(,a,/3;(w)))dmw) 
Jo 

+ | r(f(8,a,/3;(w)))d9,0 < s < t. 
Jo 

Therefore the stopped path at t of x{., a, w) is 
F(s,a,j3;(w)) = 



\f{s,a,ft{w)), 0<s<t 
\f(t,a,j3;(w)), s>t. 



Now 

x(t + s, a, w) 

- x{t, a,w)+ I p{x(+t, a, w))dp{6 + t, w) + I r(x(6 + t, a, w))d9 

Jo Jo 

= x{t, a, w) + I p{x(9 + t, a, w))d/3"{9, w) + J r{x{0 + t, a, w))d9. 
Jo Jo 

From Theorem [5] and uniqueness part of Theorem of ^ of § [5] we 

have therefore 

x(t + s, a, w) - y(s, x(t, a, w), w) = x(s, x(t, a, w),fi'(w)) 
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207 Let Bi e B f (w) and P 2 e B(w). Then by definition of P a 

P a [W e Bi, W f + e B 2 ] - PM-, a, w) € B u x(t + ., a, w) e B 2 ] 

= P[F(.,a,fl-(w)) e B' v x(.,F(t,a,B;(w)),J3'(w)) e P 2 ] 

where B\ = (w : wj e B'\). Let Pg- and Pp be the probabilities induced 
on ^€ by 67 and B' ; since they are independent they induce the product 
probability Pp- x Pp> on ^ x ^ '. We have therefore, 

P fl (weBi,w r + €B 2 ) 

= (P^ X/»[(#y) : F(.,a,w) € S / 1 ,jc(.,F(f,a,w),w / ) € B 2 ] 

= J" P^(<iw)P[V : F(.,a.w) e Pi,x(.,P(?,a,w), w') e B 2 ] 
Pp ; {dw)P[w' : F(.,a.w) € B u x{.,F{t,a,w),B' {w')) e fi 2 ] 



= J P(dw)P[w' : F(.,a,B;(w))eB[,xi.,F(t,a,B;(w)),p'(w'))eB 2 ] 
P[w' : x(.,F(t,a,B;(w)),J3'(w')) e B 2 ]P(dw) 



(w:F(., a ,/?r(w))efi' 1 ) 

P[w' : x(.,x(/,a,w),/3(vv')) e B 2 ]P(<iw) 



(w:F(.,a, J 87(w))eB' 1 ) 

since /? and B' induce the same probability on c to. Thus by definition of 
Pb we have 



P a [w : w € Pi, w f + € B 2 ] = J~ P^ 



vv) [P 2 ]P(cfw) 
(w:F(.^-(w)€S'j) 
= F a [5i : Pjt,(w)(B2)] 

We have derived the Markov property. 

From the remark at the end of TheoremEJof §|5]we see that if a n — > a 208 
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there exists a subsequence a n \ such that 

x(t, a„k, w) — > x(t, a, w) a.e. 

Since H t f(a) = E a [f(x t (w))] = j f(x(t, a, w))P(dw) if / is continu- 

n 

ous and a n — > a then there exists a subsequnce a„u such that H t f(a„k) — > 
H t f(a). Since this is true of every sequence a„ — > a.we should have 

RmH t f(b) = H t f(a). 

b—>a 

M is therefore a strong Markov process. The definition of P a shows that 
M is conservative. 

Theorem 1. Ifu, u', u" are all continuous and ifu and -^p 2 u" + ru' are 
bounded, then u e l 3(^S~)($§ in the restricted sense) and 

<Su - -P 2 u" + ru. 
2 

Proof. It is enough to prove that aG a u - u - G a [-P 2 u" + ru']. From 
the theorem of §|5]we have 



u(x(t, a, w)) - u(x(0, a, w)) + I u'(x(s, a, w))p(x(s, a, w))d[3{s) 

Jo 

—P (x(s, a, w))u (x(s, a, w)) + u (x(s, a, w))r(x(s, a, w)) 



ds. 



Write F(s, a, w) = -P 2 (x(s,a,w))u"(x(s,a,w)) + u'(x(s,a,w)) 
209 r(x(s, a, w)). Then since x(0, a, w) = a, 

/u(x(t,a,w))P(dw) - u(a) + I ds I F(s, a, w)P(dw) (1) 
Jo Ja 

n 

since the expectation of a stochastic integral is zero. 
Thus 



a e- at dt 
Jo Ja 



e dt u(x(t,a,w))dP(w) 
'a 
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- u(a) + I ae~ at dt I ds I F(s,a,w)dP(dw) 
Jo Jo Jn 

= u(a) +| ds I F(s, a, w)P(dw) J ae~ at dt 
Jo Jn J* 

= w(a) + [ <is I F(5,a,w)P(Jw)e~ c " 
Jo Jn 

Q.E.D □ 

Theorem l.lfu satisfies the conditions of Theorem^ then 

H t u(a) - u(a) 1 „ ,,, s , s s 

lim v — - -P 2 (a)u"(a) + r(a)w'(a). 

?^o t 2 

This is immediate from equation Q above, since all the functions 
involved are continuous. 

Theorem 3. Let P(t, a, E) be the transition probability of the above dif- 
fusion. Then the following Kolmogoroff conditions are true. 

(A) \im-P(t,a,U c a ) = 

f— >o t 

1 r 

(B) lim - Lib- a)P(t, a, db) = r(a) 

f->0 t JU " 

(C) lim - f (b - a) 2 P(t, a, db) = P 2 {a) 

t^O t JU " 

where U a is any bounded open set containing a. 

Proof. We can prove these facts using stochastic differential equations; 
but we shall deduce them from TheoremEJabove. 

(A) Let V a be any open set containing a with V a c U a and let u be a 210 
Ci function such that u = on V a , u = 1 on U c a and < u < 1 on 
Ua ~ Va- Then u satisfies the conditions of Theorem [fl We have 

< ^P(t,a, U c a ) < ^[H t u{a) - u{a)] ^p 2 u"{a) + ru'{a) = 0. 
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(B) Let V a D U a and let € be a C2 function vanishing outside V a , 1 on 
E/fl and <e< 1. Put u(b) = (b - a) e (a). Then 

lim —[H t u(a) - u{a)] - -p 2 u"{a) + ru'{a) - r(a) 
r-»0 t 2 



7 r «( 



i.e., lim- u(b)P(t,a,db) = r(a). 

t-tO * 



Also 

lim |- f u(b)P(t,a,db) - - f (b - a)P(t,a,db)\ 



<iim- f \b-a\\e(b)-l\P(t,a,db) 



< 



limC- f P(t,a,db) = 



from (A), where C is a bound for |ft - a\\ e (ft) - 1| on V a - U a . 
(C) Take u(b) = (b - a) 2 e (b) in (ft). 

□ 

Remark. Theorem QJmeans (in an intuitive sense) 

P a Qdx t \ >e) = 0(dt),E a (dx t ) ~ r(a)dt, 
V a (dx t ) = E a {(dx t ) 2 ) ~ p 2 {a)dt. 



Section 6 

Linear Diffusion 



We recall the definition of a diffusion. A strong Markov process whose 211 
path functions are continuous before the killing time is called a dimsion. 
In this section we develop the theory (due to Feller) of linear diffusion. 

1 Generalities 

Definition (). A diffusion whose state space S is a linear connected set 
is called a linear diffusion. 

S is therefore one of the following sets, upto isomorphism i.e., order 
preserving homeomorphism of linear connected sets: 

(1) [0, 1], (2) [0,1), (3) (0,1], (4) (0,1), (5){0). 

Let o~b denote the first passage time for b, i.e. 07, = inf{? : x t = b}. 
If P a {o~b < °°) > 0, we write a — > b; if a — > b for some b > a, we 
write a e C + ; if a — > b for some b < a, we write a e C . If a -» b for 
any b > a, i.e. if a C + we write a e K^; similarly if a -» for any 
b < a, i.e. if a ^ C_, we wrire a e i^. Thus if a e K+ and ft < a then 
^a(oi> = °°) = 1, i-e. P a (x f > a for all ? < cFoo) - 1. 

Every point of the state space 5 belongs to one of the following sets: 

1. C + n C = K c + n K c l. These points are called regular points or 212 
second order points. 
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2. C + - C- - K + - . A point of this set is called a pure right shunt. 

3. C- - C+ - K - K+. A point of this set is called a pure left 
Shunt. Both left and right shunts are sometimes called points of 
first order, i.e. a point of first order is an element of C + - C_) U 
(C_ - C + ). 

4. C c _ n C c + - K n K+. These points are called trap points or points 
of order zero. 

The intuitive meanings of the above should be clear; for instance of 
particle starting at a pure right shunt travels to the right with probabil- 
ity 1. 

Theorem 1. If a e C + (e c^), then P a (o- a+ = 0) = l(P a (cr a _ = 0) = 1), 
where cr a+ = inf[t : x t > a)(cr a = inf{? : x t < a}). 

Proof. Let cr - a a+ and a e C + . There exists b > a, and t such that 
Pa(o-b < t) > 0. Now E a (d-°~ b ) > e-tPaio-b < t) > 0. Since cr b (w) = 
cr(w) + (XfofwJ) we have, by the strong Markov property, 

< Eaie' ' 1 ') = E a (e r(Tb : a h < oo) = E a {e~ (Tb : a < oo, cr h < oo 
= ^(g-^^O : cr < oo, o- h (yvl) < oo) 

- EJe-^^Ce-^ : cr fe < oo) : cr < oo] 

- Eaie^Eaie-^) : cr < oo) = E^e^E^). Q.E.D 

□ 

213 Remark. If M is not strong Markov the theorem is not true (e.g. expo- 
nential holding time process). 

Theorem 2. If a -> b > a(< a) then [a, b) c C+((b, a] c C_. 

Proo/ Let a < £ < b. Then /^(cr^ < cr^) = 1, because the paths are 
continuous. We have 

< P a (o- b < oo) = P a {a^ < oo, o- h <oo) = P a (o-{ < oo, cr fe (w£p < oo) 
= E a [P x ^(cr b < oo) : cr f < oo = ^[cr/, < oo]P a (cr^ < oo), 

since by continuity x(cr^) - Therefore P^(crb < oo) > 0. Q.E.D. □ 



2. Generator in the restricted sense 
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Corollary (). If a € C + then some right neighbourhood (i.e. a set which 
contains an interval [a, b )) of a, U + (a) c C+. 

Theorem 3. The set of regular points is open. 

Proof. Since a € C + , there exists b > a with P a (p~b < 00 ) > and since 
a e C_, by Theorem[l] P a (o~ a _ = 0) = 1. Hence P a {cr a < cry < oo) > 0; 
this implies that there exists c < a such that P a (cr c < cri, < oo) > 0. 
Noting that a e C + and using Theorem there exists d,a < d < b, with 
Pa(o~d < o~ c < crd < oo) > 0. Using the strong Markov property 

^/(Orf < oo)P rf (cr ( . < oo)P c .(o- rf < oo) > 0, 

so that Pd(cr c < oo) > 0, .P c (oi, < oo) > 0. Hence (c, <i] c C_ and 
[c,i)eC + . Q.E.D. □ 

Theorem 4. jj n'g/j? closed, i.e. a n e K + ,a n la imply a e K + (k- is 
left closed). 

Proof. If a i K + then a € c_. There exists ft < a and a — > ft. 

Then (ft, a] c c_ so that (ft, a] n ^ + = 0. Q.E.D. □ 214 



2 Generator in the restricted sense 

In the section of strong Markov processes we introduced a generator in 
the restricted sense; we modify this to suit our special requirements. Let 
- {/ : / € B(5) and / is right continuous at every point of 
C + and left continuous at every point of C_. &(S) is smaller than the 
classes D(S) introduced before in the section of strong Markov pro- 
cesses. Clearly / € 2#(S) is continuous at every regular point and 
9{S) D C(S). 

Theorem 1. ®(S) 3 G a /3(S); a fortiori G a 9{S) c &{S). 
Proof. Let a e C+. Then 

G a f(a) - E a I JT 
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Ea\ e~ M f{x t )dt\ + E a {e' a ^)G a f(h). 



Ea\ e~ at f{x t )dt\+E a \ e- at f{x t )dt 



Ea\ e~ at f{x t )dt \ + E a {e' acrh G a f(x (Tb )) 




Now 



\E a [ e at f{x t )dt 




I < 11/11 



1 _ E{e' a<Th ) 



a 



* 11/11 



1 - E(e 



a 



= 0, 



since 



P a (0- a+ - 0) - 1. 



Q.E.D 



We can prove that G a Qi(S) is independent of a and the other results 



215 Theorem 2. G a f = 0, / e @(S) imply f = 0. 

Proof. It is enough to show that P a (f(x t ) — > /(a) as ? - 0) = 1. 

If a is regular, / is continuous at a and there is nothing to prove. If 
a e C + - C , f is right continuous at a and P a (x t >afor0<t< ctco) = 1 
and again the result is immediate. If a e C - C + the same is true. If 
a is a trap P a (x t - a for < t < cr^) = 1 and since P a (o-co > 0) = 1 
(because P a (xo = a) = 1) the result follows again. □ 

Definition (). We define the generator in the restricted sense as 5fw = 
au - f where u = G a f with f e 3>{S). One easily verifies that is 
independent of a. 

Theorem 3. If a is a trap, then P a (o-oo > t) = P a (T a > t) = e~ kt 
and %?u(a) = -ku(a) where k > and T a = first leaving time from 
a - inf{? : x t + a}. 

Proof. Proceeding as in the case of a Morkov process with discrete 
space (Section 2, § 8) we show that P a (j a > t) - e~ kt and - = E a {r a ) if 



easily. 



□ 



k 
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oo > k> 0. If k = 0, P a (T a > t) - 1 for all ?, giving P a (r a = oo) = 1 i.e. 
P a (x t = a for all 0-1 (such a point is called a conservative trap). We 
have^w(a) - au(a)-f(a) - a J e~ at E a (j(x t ))dt-f(a) = f(a)-f(a) = 

0. Let now oo > k > 0. Since - = E a {T a ), by Dynkins formula, 



&u(x t )dt\ = E a (u(x T J) - u(a), 



i.e., 

E a {T(0u(a)) - -u(a), since w(x Tfl ) - w(oo) = 0. 
Q.E.D. □ 

Theorem 4 (Dynkin). If a is not a trap then E a (ru) < 00 for a suffi- 216 
ciently small open neighbourhood U of a and 

, a , N ,. E a (u(x Tu )) - u(a) 
9u(a) = hm — — , 

U^a E a (ju) 

where Ty = first leaving time from U. 

Proof. We prove that if a is not a trap, there exists uq € such 
that u (a) > 0. Let <gu(a) = for every u e 9(<g). Then for all 

/ e C(S),a.G a f(a) - f(a) = i.e. JT H t f{a)e^dt = -f(a) = 

jo a 

J e~ at f(a)dt. Since for / e C(S),H t f is right continuous in t, 
H,f(a) = f(a) i.e. / f(b)P(t,a,db) = f(a) for all / e C(S). It fol- 
lows that P(t, a, db) = 6 s (db) i.e. P a (x t = a) = 1 for all t. By right 
continuity P a (x t - a) for all t) - 1, i.e. a is a trap. Thus there exists uq 
such that ^Mo(a) ^ 0. 

From the definition of @(S) we see that there exists eo > and a 
neighbourhood Uq(o) such that 



&u (b) >€ 



for be Uo(a)ifais regular, 

for b e Uo(a) and b > a if a is a pure right shunt, 

for ft € Uo(a) and ft < a if a is a pure left shunt. 
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Therefore P a (^uo(x t ) >€<) for < t < Tj/ ) = 1. Now put t„ = 
nATu - Then 



so that 



^u Q (x t )dt) - E a (uo(x T J) - uq(z) 



e E a (T n ) < 2\\uq\\. 



>oll 



217 Letting n — > oo, E a (Tu ) < 2 < oo. Therefore for t/ c t/o(A), 

£" fl (T{/) < oo. 

Now let u e i^($f). For every e> 0, there exists a open neighbour- 
hood U(a) c Uo(a) such that 



\&u(b) - &u(a)\ <g 



for b e U(a) if a is regular, 

for b e f/(a) and b > a if a is a pure right shunt, 

for b € t/(a) and b < a if a is a pure left shunt. 



Therefore P a (|Sfw(jc,) - Sfw(a)l <e for < t < t v ) = 1. Using 
Dynkin's formula the proof can be easily completed. 



3 Local generator 

Let M = (S , W, P a ) denote a linear diffusion, and S ' a closed interval 
in S. Put W = W C (S'), P' a (B') = P a [w~ e B'], where r = r (5 , )0 (w) 
is the first leaving time from the interior (S')° of (5")- We prove that 
M' = (5", W',Pa) is also a linear diffusion. We shall verify the strong 
Markov property for M'. First we show that, if cr'(w') is a Markov time 
in W, then <t(w) - cr'(w~ J is a Markov time in W Now 

(w : cr(w) >t) = [w: cr>; (w) ) > ?)] = (w : hQ w) ) e B' t ), B\ e b; 
= ( W :(^ (l[) )-eB'),B'eB'cB 
= (w : f < t(w), w f " e B') U (w : r(w) < f, (vt>;"); (w) e B') 
= (w : t < t(w), w~B') U (w : t(w) < f, (w7) T(wr) e B') e B, 

218 since w — > is B r measurable and w — > is B-measurable for any 
Markov time we have (w : (wp~ , e 6) e B, for any 8eB. 
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Thus cr is a Markov time in W. Let f[ e and ft € . Then 
by definition of P' a we have 

K [/i'(w')/ 2 '(w^ (M/) )] = E a [/((w T - (w) )/^((w; (vv) )J (vv) )] 

Put - yj(w^ w) ) and f 2 (w) = f}(w; (w) ). Let o~ 2 = cr At. We 
show that f\ e &o- 2+ . Now 

■/i( W 0-2(w)+ ( S = fl^ W o- 1 (w)+6\(w- 2(w)+ J = U [( W r(w))o-(w)+<s] 

= fx [(w; (w) )-, (w - m)+6 ] + = /i« (vv) ), since ft e ^ + 

This proves that /1 e ^o- 2 +. From the definition of t and o~ 2 we can 
see without difficulty that for any t > 0, 

cr 2 (w) + (f A r(w+ 2(w) )) = t(w) A (cr(w) + 

Hence (wt , A )~ + ) = (wC, so that 

/2[^ 2(w) ] = f\ ( w t 2 (w)\(w* 2 (w)) = fl [( W r(w))^r(w)] • 

Thus 

K [fW)f>X'A = E " [/l(^))/2(K(w)): ( w))] 

= [/i(w)/ 2 « 2 )] - £ a [/i(w)£^(/ 2 (w))] 

= [/l«(w)) £ ^(w)«(w))(/2( w r(w)))] 
= ^[/>0^ (/>'))] 

which proves that M' is a linear diffusion. M' is called the stopped pro- 219 
cess at the boundary 35" of 5". We also denote M' by Ms>, its generator 
by Sf' or ^, etc. 

A point a e 5 is called a conservative point if there exists a neigh- 



bourhood U such that 



is conservative. The set of all conservative 



points is evidently open. Let a be a conservative regular point and 5 'a 
closed interval containing a such that M$' is conservative. We shall 
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prove that if u e @<&), then u' = u\S' e 9<&') and <g'u' = in 
(5')°; more generally if S' D 5", if u' e 9(^ S ') then «" = u' IS" 
(restriction to S") is in S>(^ S ") and ( S' u' = &"u" in (S")°. Then we 
can define % the local generator as the inductive limit of > as 5" J, a 
in the following way. Consider the set of all functions defined in a 
neighbourhood (which may depend on the function) right (left) contin- 
uous at points of C + (C_). Introduce an equivalence relation in Q a by 
putting / ~ g if only if there exists a neighbourhood U of a such that 
/ = g in U. Let £> a (S) = 3> a (S)l ~ (the equivalence classes). Define 
®<& a ) = {u:ue %(S) and there exist U = U(a) with u\U e ^(S%). 
220 Define f^ a « - (S%m)/ ~ where w = u\ ~,u\U e From above 

it follows that this is independent of the choice of u. We now prove that 
if ue®($) then u' = u\S' e W) and % = S7V in (5')°. Note that if 
[b, c ]=S',t = tu = cr h A <r c , U = (S'f. We have 



by strong Markov property. Put /' = / in U, f'(b) = aG a f(b) and 
f'(c) - aG a f(c). Then it is easy to show that u' - u\s' = G' a f and 
S7V = &u in U. 

Definition (). % is called the local generator at a. 





= E^J e~ at f{x t {w;))dtj + G a f{b)Ef{e- a<Tb : <r b < cr c ) 
+ G a f(c)Ef(e- a ^ : cr c < <r*) 




4. Feller's form of generators (1) Scale 
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4 Feller's form of generators (1) Scale 

We shall derive Feller's cannocial form of generators by purely proba- 
bilistic methods following Dynkin in the following articles. 

Let a be a conservative regular point. There exists U - U(d) - (b, c) 
such that U has only conservative regular point and E^(tu) - E^(8qu) < 
oo for £ e U. Put = P^(cr c < cr b ). 

(1°) s € and %s = in U. 

Let f(c) = 1 and /(£) - 0, £ € [ft, c). Then / e @{U) = <2j' and 



Hence lim e G'J{£) - P^{cr c < o~b) - s(g). The resolvent equa- 



Letting e — > we get + aG' a s(^) = 0. Therefore firstly 

jef and again since s - aG' a s, s e and 



(2°) is continuous in U. 

Since sef and all points of U are regular for s', s is continuous 
in I/. 

It remains to prove that s is continuous at b and c. We prove the 
continuity at c; continuity at b is proved in the same way. To prove 




40 
tion gives 



(G' a -G' £ )f + (a-e)G' a G'J = or 
e(G' a -G' e )f + (a-e)G' a G' e f = 0. 



&'s = as-(G' a )~ 1 s = as-as = in U. 
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this we shall first prove that e - UmE(e °~ c -) - 1 or 0, cr c _ = 
limo> Let £ < n < £ < c. Then E^e'^) = E s (e- <r i)E v (e- crc -). 

rife 

Letting n 1 c, now and % \ c finally we get e = e 2 so that e = 1 or 
0. Since c is regular, there exists £ < c such that P^(cr c < oo) > 

222 and then E^e^) > 0. Also cr c > cr c _. It follows that E^{e~ (Tc -) > 
0. Hence e = 1 . Since £ is conservative 

P&cr c _ ~ °°,0- c - < OO) < P^fToo < OO) - 0. 

Therefore since cr c > cr c _ and the paths are continuous before the 
killing time, Pg(cr c - cr c _) = 1. We have proved that ]imEg(e~°' c ) 

= 1. For every e > 0, therefore, lim P«(cr c < e) = 1. Also 

f-»c - 

5© = P f (cr e < cr fc ) > P f (cr c <e,cr b >€)> P f (<r c < e) - P f (o"i < e) 

If ft < £o < £ < c, then 

P^o- h < e) < P f (cr fo < oo, o- 6 (w+ fe ) < e) 
^ ^(o"ft < °°)P^b <e)< P ft (tri < e) 

Therefore > Pf(<x c < e) - Pg (<Tb < e). Letting % \ c first and 
e i next, we get lim > 1 i.e. s(g) is continuous at £ = c. 

(3°) s(g) is strictly increasing. 

The set of points g,b < g < c such that s(g) = is closed in (b, c\. 
If P{ (cr c < <Jb) = 0, the same is evidently true for any b < g < £o- 
Since £o is regular lim P^ (<r^ < e) = 1 for any e > 0. Also 

Pxio(°~b > 0) = 1. It easily follows that limP^(cr^ < cr^) = 1. 

Choose 7/o > £o with Pg (cr m < <Tb) > 0. Then P^ (o"^ < 07,) > 

223 for any £o < V < Vo- Now that if a < £ then (cr a < cr^) = (w : 
o-g(w~ a ) - oo), and hence is in B^. We have = P^ (cr a < 
°~b) = P^oio-r, < o- h )P n (<J c < cr h ). Thus P^(cr c < cr h ) = 0. 
The connectedness of (b, c] shows that + in (ft, c]. Exactly 



4. Feller's form of generators (1) Scale 



189 



similar argument also shows that s(g) < 1 in [b, c). Now if £ < rj, 
we replace c by rj and repeat the argument to get P^cr^ < o- b ) < 1. 
Thus if cr < 77 

- P f (cr c < cr b ) = P^{o- n < <r b )P n (<T c < cr h ) < P V ((T C < (T b ) 

(4°) as + p is the general solution of Wu = 0. 

Let m = 1 for b < £ < c. Then /(# = 1 - a^(/ °° e~ at f(x t )dt) 
- a0' a f{i;). This firstly shows that / e ^'(V) and then the same 
equation shows that / e ®(&'). Thus <S'\a- l-(G^)" 1 1 = a-a = 
0. Hence since &'s = Sf'(a,s + p) = 0. Now let Wu = 0. Then 



= £dj~ 9'u 



(x t )dt 



= Eg(u(x Tu )) - m(£) = E^(u(x Tu )) - u(%) 



= u(b)P^{cr b < cr c ) + u(c)P^(cr c < o- b ) - 
Therefore m is linear in s. 

s(£) - s(b') 

(5°) If b < V < $ < c> < c then P^tr, < <r v ) = -ff 

s(c') - s(b') 

Let x - Pg(cr c > < cry), y - P{(o~b' < o~c')'> then x + y - 1 and 
P s (o- c < cr h ) = P^(o- c > < cr b )P c >(cr c < cr h ) 

Also 

(ov < cr h ) = (cr c > < cry) U (ov > ^.o-j^) > ov(wJ A ,)) 
Therefore 224 
P f (cr c < o- b ) = P f (ov < o- b >)Pc>{o- c < cr h ) + Pfio-c- > cr b ',o- b (w+ v ) 

> cr c ,(w + . bl ))P c >(o- c < a b ) 
= xs(c') + P%(o- c > > o- h >)P b >(cr h > cr c ,)P c ,(o- c < cr b ) 
= xs(c') + P^cry < cr c >)P b >(o- c < cr b ) 
i.e., s(£) - x s(c') + y s(b'). Solving for x we get the result. 

□ 

Definition (). s is called the canonical sacle in b, c. 
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5 Feller's form of generator (2) Speed measure 

Let p(g) = E'^tu) = E^tu), U = (b, c). Put / = 1 for x e U, f(b) = 
f(c) = 0. Then G'J{%) = E'^ jjV ei f(x t )dt^ = E ^f ^ £t dt\^, so that 

limG' e /(f) = /*f) 
We have G'J - G'J + (or - e)G' a G' e f = 0. Letting 6^0 

g;/-p + og;p = o. 

This shows that p e S>{^'), because, / being indentically 1 in U, is 
continuous at every regular-point and b, c are traps for M'. We have, 

(1°) &'p = -f i.e. &'p = -1 in U, &'p(b) = <g'p{c) = 

• p is continuous in U and p(b) - p(c) = 0. 

We prove that p(c-) - p{c) - 0. Let b < £ < c and = r^. 
Then if 6 < £ 

^o( T C/) = %( T f) + %(TC/(>Vp) = ^o( T ?) 

+ E^{E Xt ^tu) : o- f < cr h ) = %(r ? ) + E^tu)P^{o-^ < cr b ). 

Now as £ — > c,Eg (rg) — > Eg (Tu) and cr^ — > cr c . Therefore 
lim£: f (T^)Pf ((r c < cr fo ) = i.e. p(c-) = 0. 

f-»c 

(3°) p is the only solution of Wu - -1 in U, u{b) = u{c) = 0. 

TV 

For -/>(£) - -Ef(Tu) = E%{ j Tu(x t )dt) = Ef(u(x Tu )) - 

o 

Since x Tu = b or c, u(x Tu ) = 0. Q.E.D. 

(4°) We have proved that s : [b, c] — > [0, 1] is 1 - 1 continuous. We 
define a mapping p' on [0, 1] by p'(s(g)) - p{%). To prove that p' 
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is strictly concave in [0, 1]. We express this by "p is concave in 
s". We have to prove that, rib <r\ c 

p(0> s( °- s{ti) p(0 + s{0 - s ^p(v). 

Now/?(£) - E^tu) - £ f (tr - Tjj(w+)), cr - T nZ > E(:{t u {w+)) = 
right side of the above inequlity 

d + p 

(5°) m(£) = is strictly increasing and bounded if there exists an 

ds 

interval V D r such that £f (ry)oo and My is conservative. (The 
measure dm is called the speed measure for U). 

d + p 

From (4°) the right derivative — — exists and strictly increases. We 226 

ds 

prove that it is bounded. Let V - (b\,c\) D [b,c]. Put pi(£) = E^ijy), 
= Pf(o- Cl < cr hl ). We have 

Pi(0 - ^(rj/) + ^(ry(w^)) = p(0 + ^)Pi(c) + (1 - *(0)Pi(&). 

From this one easily sees that 

1 



mm - -d + pi(%)ds x = [m(0 - (P { (c) - Pl (b))] 



51 (C) - 5i (ft) 

Q.E.D. 



6 Feller's form of generators (3) 

Theorem (Feller), u e 30^') if and only if 

(1) u is of bounded variation in U 

(2) du < ds i.e. du is absolutely continuous with respect to ds. 
du 

(3) — (Radon Nikodym derivative) is of bounded variation in U. 
ds 

du 

(4) d— < dm in U. 

ds 
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du d du 

(5) id— ) I dm (which we shall write — — has a continuous version in 

ds dm ds 

U. 

_ d du 

(6) u is continuous at b and c i.e. u is continuous in U and §f u 

dm ds 

in U, &U — at b and c. 
Proof. (Dynkin) Let u e (^')- Then for some f e S>' 

ITU 
J e- at f(x t )dt 



-acr b 



+ E^e-^" : cr h < o-J-^- + t^-E^T"' : cr c < tr b ). 
a a 



fib) /(c) 

Thus lim u(g) - - u(b) and lim u(g) - - u(c). u is 

f->& a £->c a 

227 therefore continuous in U. 

Let [a,fi] c U. If &'V > in (a, ft) then Dynkin's formula shows 



T a Acrp 



0<E\ 



(x t )dt 



s(J3) - s(t) /m s(Q-s(a) 
s(p) - s(a) s(p) - s(a) 



so that v is convex in s and hence is of bounded variation in [a,fS\. Also 

d + v 

— — exists and increases in [a,/3] and dv is absolutely continuous with 

as 

respect to ds. If <g'v > A in (a,f3), then Sf'(v + /I/?) > in (a,/3). 

Therefore d— > iJm. Similarly if ^"v < /u in (a,/?) then <i— < 
[idm. 

Consider a division A = (b - ao < a\ < ■ ■ ■ < a n - c) of [b, c]. Put 
^ = inf &'uit),w = sup <g'ui£). 

fe(a,-,a, + i) fe(a,-,a /+ i) 



Then ^dm > d—— > Ajdm in (or,, q-j+i) and /^<im > W'udm > Aidm 
ds 

in (or,-, q- ;+ i). Putting /i(£) = A { and //(£) = ^ for ce, < £ < cc; + i we 
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have n(£)dm > d^—^- > A(g)dm, and n(%)dm > ^'u(^)dm > A(%)dm. 
ds ' 

Therefore Qi(g) - A(£))dm > d^- - ^'u(^)dm > -Qi(g) - A(£))dm. As 

ds 

5(A) = max[a,+i - a,] tends to zero, /i(£) - A(%) — > 0. We have 

i 

d + u 

d—— =W udm in U. 

ds 



Conversely suppose that u satisfies all the above six conditions. De- 
fine f - au — - — —u in U and f(b) - au(b),f(c) - au(c). Then 
dm ds 

since / is continuous in U,f e . Let v = G' a f. From what we 

d d b 
have already proved av — - — — v = / in U, v(b) - —f{b), v(c) = 

dm ds a 

—f(c). If 9 - u - v then 9 is continuous in U, 9(b) = 9(c) = 0, and 
a 

d d 

a9 — - — —9 - 0. There exists a point ft sucn that 0(ft)is a maxi- 
dm ds 

d d d 
mum. Now 0(ft) >-» 0(£) > near ft => -, — r# > near £o => ~r9 

dm ds ds 
strictly increases near ft. Then if £ > ft > r\ are near ft we have 

-0(77) = J-j-rfJ < X (^o)[^o)-^)]. Hence —(ft) > 0. On the 

C<i0 d9 

other hand 0(£) - 0(ft) = — > — (ft)[s(£)- s(ft)], a contradiction. 

g ds ds 

Therefore 6(g) < 0. Smiliarly we prove 9(g) > 0. Q.E.D. □ 
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7 Feller's form of generators (4) Conservative com- 
pact interval 

Let / = [b, c] be a conservative compact regular interval i.e., a compact 
interval consisting only of conservative regular points. We shall prove 
the following 



Theorem (Feller). All the results of the three articles hold for M/. 
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6. Linear Diffusion 



Proof. Since every a e / is conservative regular, we can associate with 
any a e / an open interval U (a) such that Eg(Tu( a )) < °° for £ e U (a) 

229 and then the results of the last three articles are true for M^y. Denote 
the quantities s, p, m etc. for U by sy, pu, m\j, etc. Let s - P^{cr c < o~h). 
Then from (5°) of £4 we get 

s(g) = s(b') + [s(c') - sib'Wficrc < o-vX 

where £9(b',c') is an interval such that the results of the last three ar- 
ticles are true for M[b>, C ']- This equation shows that s(£) is strictly in- 
creasing and continuous in some neighbourhood of the point There- 
fore is strictly increasing and continuous in /, and s is linear in su 
in U, for every interval U such that the results of the last three arti- 
cles are true for Mq. Let dm be a measure defined on B(7) as follows. 

dm = — dmu if in U, s = ausu + f$u- Let V n U = W + (j). Since 
a v 

Pu = Pw + Pu(b') + s w {%)[pu{c') - pu(b')] where U = {b', c') we have 

— dmu = dmw = — dmy. Therefore the measure dm is uniquely de- 

au ay 

d d d d 

fined on B(7) and = in U. dm is defined by a strictly 

dm ds dsu dsu 
increasing function m (say) in /. Consider now the following "differen- 
tial equation" 

d d 

u - -1 in (b,c) and u(b+) = u(c-) = 0. 

dm ds 

f c- l 

Then p(g) = - J m{n)ds{n) + / m{n)ds{n)[s{0 - S(b)] 

b+ b+ S( - C > S ^ t> > 

d d 

is a solution and {a )p - ap + 1 in (b, c) and p{b+) - p{c-) = 0. 

dm ds 

Let / = ap + 1 in (b, c) and f(b) = f(c) = 0. Since / is continuous in 

230 (b, c), f e @ h Let v - G'f. Then v e ^(£f 7 ) and {a - £f 7 )v = ap + I. 

v e (^ 7 ) =>ve S){^°) so that (or — - — )v - ar/?+l in [/. Therefore 

(a — - — — )v = ap + 1 in (/?, c). Since v e S^i^ 1 ), it is continuous in /. 
dm dS 

d d 

Let 6 - p - v. 6 is continuous in / and {a — - — —)G = 0. We prove as 

dm dS 
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in §|5|that = 0. Thus /?(£) = v(£) € ^(^ 7 )- Using Dynkin's formula 
we have, if t„ = t^,c) An = t An (say) 



i.e., 



EfiTn) < 2\\p\\ < oo. We get E^t) < oo. 
Again using Dynkin's formula 



/ T 



p(x t )dt 



vo 



Eg(p(xr)) - p(g) i.e. p(£) = E^t^c)). 



The proof of the theorem can be completed as in § |5| 



□ 
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